[ 584.118967] env[69219]: INFO neutron.common.config [-] Logging enabled! [ 584.119412] env[69219]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.1.0.dev73 [ 584.119412] env[69219]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69219) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 584.119717] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 584.119820] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 584.120674] env[69219]: WARNING oslo_policy.policy [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 584.120905] env[69219]: WARNING oslo_policy.policy [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 584.122439] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] VMware NSXv3 Agent initialized successfully. [ 584.122802] env[69219]: DEBUG oslo_concurrency.lockutils [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] Acquiring lock "singleton_lock" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.122941] env[69219]: DEBUG oslo_concurrency.lockutils [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] Acquired lock "singleton_lock" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.123167] env[69219]: DEBUG oslo_concurrency.lockutils [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] Releasing lock "singleton_lock" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.123457] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] Full set of CONF: {{(pid=69219) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 584.123673] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ******************************************************************************** {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 584.123795] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] Configuration options gathered from: {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 584.124053] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 584.124233] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 584.124350] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ================================================================================ {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 584.124526] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] agent_down_time = 75 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.124674] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] allow_automatic_dhcp_failover = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.124812] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] allow_bulk = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.124964] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] api_extensions_path = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.125125] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] api_paste_config = api-paste.ini {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.125299] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] auth_strategy = keystone {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.125426] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] backdoor_port = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.125543] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] backdoor_socket = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.125691] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] backlog = 4096 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.125841] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.126015] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] bind_host = 0.0.0.0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.126176] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] bind_port = 9696 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.126322] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] client_socket_timeout = 900 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.126471] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] config_dir = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.126590] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.126734] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] config_source = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.126882] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] control_exchange = neutron {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.127038] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] core_plugin = ml2 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.127188] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] debug = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.127357] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] default_availability_zones = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.127571] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.127716] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] dhcp_agent_notification = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.127861] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] dhcp_agents_per_network = 1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.128012] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] dhcp_lease_duration = 86400 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.128171] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] dhcp_load_type = networks {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.128342] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] dns_domain = openstacklocal {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.128516] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.128661] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] enable_default_route_bfd = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.128801] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] enable_default_route_ecmp = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.128939] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] enable_dvr = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.129092] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] enable_new_agents = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.129234] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.129371] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] enable_signals = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.129508] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] enable_traditional_dhcp = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.129654] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] external_dns_driver = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.129781] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] filter_validation = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.129929] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] global_physnet_mtu = 8950 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.130103] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] graceful_shutdown_timeout = 60 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.130255] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] host = cpu-1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.130402] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] host_dvr_for_dhcp = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.130543] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] http_retries = 3 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.130691] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] instance_format = [instance: %(uuid)s] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.130836] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.130981] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ipam_driver = internal {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.131133] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ipv6_pd_enabled = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.131273] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] l3_ha = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.131419] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.131564] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] l3_ha_network_physical_name = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.131707] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] l3_ha_network_type = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.131852] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_color = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.131994] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_config_append = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.132154] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.132295] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_dir = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.132432] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_file = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.132544] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_options = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.132686] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_rotate_interval = 1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.132834] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_rotate_interval_type = days {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.132979] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] log_rotation_type = none {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.133104] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.133213] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.133363] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.133510] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.133622] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.133795] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] max_dns_nameservers = 5 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.133895] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] max_header_line = 16384 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.134078] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] max_l3_agents_per_router = 3 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.134173] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] max_logfile_count = 30 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.134313] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] max_logfile_size_mb = 200 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.134442] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] max_subnet_host_routes = 20 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.134591] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] my_ip = 10.180.1.21 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.134734] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] my_ipv6 = ::1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.134871] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] network_auto_schedule = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.135012] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] network_link_prefix = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.135164] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.135336] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] notify_nova_on_port_data_changes = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.135492] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] notify_nova_on_port_status_changes = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.135641] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] pagination_max_limit = -1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.135781] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] publish_errors = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.135912] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] rate_limit_burst = 0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.136072] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] rate_limit_except_level = CRITICAL {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.136214] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] rate_limit_interval = 0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.136351] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] retry_until_window = 30 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.136491] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] router_distributed = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.136628] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] rpc_resources_processing_step = 20 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.136788] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] rpc_response_max_timeout = 600 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.136900] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] rpc_response_timeout = 60 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.137046] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] send_events_interval = 2 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.137207] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] service_plugins = ['router'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.137382] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] setproctitle = on {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.137524] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] shell_completion = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.137672] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] state_path = /opt/stack/data/neutron {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.137817] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] syslog_log_facility = LOG_USER {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.137958] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] tcp_keepidle = 600 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.138118] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] transport_url = **** {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.138304] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] use_journal = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.138492] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] use_json = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.138660] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] use_ssl = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.138823] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] use_stderr = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.138979] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] use_syslog = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.139155] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] vlan_qinq = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.139302] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] vlan_transparent = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.139453] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] watch_log_file = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.139618] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] wsgi_default_pool_size = 100 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.139762] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] wsgi_keep_alive = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.139923] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.140080] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] wsgi_server_debug = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 584.140239] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_concurrency.disable_process_locking = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.140392] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.140546] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.140688] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.140837] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.140982] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.141137] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.141296] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.connection_string = messaging:// {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.141486] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.enabled = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.141582] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.es_doc_type = notification {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.141728] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.es_scroll_size = 10000 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.141877] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.es_scroll_time = 2m {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.142023] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.filter_error_trace = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.142177] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.hmac_keys = **** {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.142323] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.sentinel_service_name = mymaster {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.142491] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.socket_timeout = 0.1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.142613] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.trace_requests = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.142743] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler.trace_sqlalchemy = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.142902] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler_jaeger.process_tags = {} {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.143054] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler_jaeger.service_name_prefix = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.143201] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] profiler_otlp.service_name_prefix = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.143359] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.enforce_new_defaults = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.143632] env[69219]: WARNING oslo_config.cfg [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 584.143789] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.enforce_scope = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.143940] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.policy_default_rule = default {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.144113] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.144260] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.144410] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.144551] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.144686] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.144823] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.144964] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.145123] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.145300] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.145522] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] agent.extensions = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.145615] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.145836] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] service_providers.service_provider = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.145910] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.default_quota = -1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.146144] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.146210] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_floatingip = 50 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.146329] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_network = 100 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.146470] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_port = 500 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.146596] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.146738] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_router = 10 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.146880] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_security_group = 10 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.147028] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.147172] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.quota_subnet = 100 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.147315] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] QUOTAS.track_quota_usage = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.147498] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.147642] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep.group = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.147780] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep.helper_command = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.147927] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.148083] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep.thread_pool_size = 8 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.148225] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep.user = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.148409] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.148565] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_dhcp_release.group = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.148706] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_dhcp_release.helper_command = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.148851] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.148993] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.149146] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_dhcp_release.user = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.149297] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.149438] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_ovs_vsctl.group = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.149577] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.149719] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.149863] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.150080] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_ovs_vsctl.user = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.150170] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_namespace.capabilities = [21] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.150295] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_namespace.group = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.150432] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_namespace.helper_command = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.150578] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.150722] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.150875] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_namespace.user = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151013] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_conntrack.capabilities = [12] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151158] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_conntrack.group = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151306] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_conntrack.helper_command = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151440] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151583] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151718] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_conntrack.user = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151866] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_link.capabilities = [12, 21] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.151995] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_link.group = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.152146] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_link.helper_command = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.152289] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.152431] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_link.thread_pool_size = 8 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.152567] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] privsep_link.user = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.152723] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.152877] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.153027] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.continue_on_failed_promotions = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.153167] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.dscp = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.153308] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.dscp_inherit = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.153455] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.force_mp_to_policy = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.153597] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.locking_coordinator_url = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.153737] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.log_agent_heartbeats = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.153878] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.logging_expire = 1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.154035] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.154185] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.154334] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.polling_interval = 240 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.154479] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.154627] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.154773] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.report_interval = 30.0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.154922] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.155081] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.155244] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.155414] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.sync_skew = 60 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.155563] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.synchronization_queue_size = 20 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.155710] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT.use_helper_for_ns_read = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.155860] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] SECURITYGROUP.enable_ipset = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.156016] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] SECURITYGROUP.enable_security_group = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.156277] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.156387] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.156540] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] experimental.ipv6_pd_enabled = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.156706] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.extension_drivers = ['port_security'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.156847] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.external_network_type = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.157009] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.157170] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.overlay_ip_version = 4 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.157351] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.path_mtu = 8950 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.157502] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.physical_network_mtus = {} {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.157663] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.157816] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.157969] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ml2.type_drivers = ['vlan'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.158136] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.158280] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.158444] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.158601] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.158754] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.158941] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.159059] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.159218] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.159397] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.159545] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.159699] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_login_password = **** {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.159850] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.159990] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_login_user = admin {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.160183] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.160291] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.160434] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.160575] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.160722] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.160871] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.161121] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.161289] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.161436] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.161588] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.161741] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.161884] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.162044] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.162241] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.162396] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.162546] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.162690] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.162836] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.auth_section = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.162988] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.auth_type = password {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.163986] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.164225] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.certfile = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.164392] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.collect_timing = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.164567] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.endpoint_type = public {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.164716] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.insecure = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.164876] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.keyfile = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.165048] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.region_name = RegionOne {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.165255] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.split_loggers = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.165442] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] nova.timeout = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.165661] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.auth_section = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.165870] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.auth_type = password {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.166029] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.166212] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.certfile = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.166384] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.collect_timing = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.166545] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.endpoint_type = public {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.166689] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.insecure = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.166902] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.keyfile = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.167081] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.region_name = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.167231] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.split_loggers = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.167394] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] placement.timeout = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.167554] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.auth_section = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.167696] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.auth_type = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.167837] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.cafile = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.167975] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.certfile = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.168137] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.collect_timing = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.168277] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.connect_retries = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.168473] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.connect_retry_delay = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.168652] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.enable_notifications = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.168797] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.endpoint_override = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.168942] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.insecure = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.169098] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.interface = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.169239] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.keyfile = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.169378] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.max_version = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.169518] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.min_version = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.169655] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.region_name = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.169792] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.retriable_status_codes = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.169928] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.service_name = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.170073] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.service_type = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.170219] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.split_loggers = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.170357] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.status_code_retries = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.170496] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.status_code_retry_delay = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.170632] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.timeout = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.170765] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.valid_interfaces = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.170901] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ironic.version = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.171057] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] cli_script.dry_run = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.171211] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.171352] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.171496] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.171637] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.171775] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.171915] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.172064] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.172207] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.172346] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.172498] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.172636] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.172785] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.172933] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.173089] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.173235] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.173395] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.173542] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.173690] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.173869] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.174024] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.174170] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.174325] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.174486] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.174629] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.174790] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.174937] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.175101] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.175263] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.175417] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.175562] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.175709] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.ssl = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.175860] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.176020] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.176171] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.176322] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.176470] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.176613] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.176763] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_notifications.driver = [] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.176903] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_notifications.retry = -1 {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.177068] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.177211] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 584.177326] env[69219]: DEBUG oslo_service.backend.eventlet.service [None req-da879971-1783-4d06-9609-b8318193e7d2 None None] ******************************************************************************** {{(pid=69219) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 584.178359] env[69219]: DEBUG neutron.agent.securitygroups_rpc [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Init firewall settings (driver=nsxv3) {{(pid=69219) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 584.179718] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69219) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 584.179971] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] RPC agent_id: nsxm-l-01a.corp.local [ 584.182242] env[69219]: DEBUG dogpile.cache.region [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 584.182368] env[69219]: DEBUG dogpile.lock [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 584.182470] env[69219]: DEBUG dogpile.lock [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 584.182565] env[69219]: DEBUG dogpile.lock [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 584.182662] env[69219]: DEBUG dogpile.cache.region [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 584.182751] env[69219]: DEBUG dogpile.lock [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 584.182875] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 584.200309] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Session token - acquiring [ 584.201775] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.201944] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.202065] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.202459] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.212018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.473402] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 584.495705] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 584.495864] env[69219]: DEBUG dogpile.cache.region [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Cache value generated in 0.313 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 584.495977] env[69219]: DEBUG dogpile.lock [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 584.496119] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Activating Policy API Provider. [ 584.496391] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Looking for the default Infrastructure Rules. [ 584.562671] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Looking for the Default Layer3 Logged Drop Section. [ 584.578489] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 584.578955] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.579140] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.579245] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.579576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.579949] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.095644] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.598124] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.100699] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Inventory metadata is going to be refreshed. [ 586.100871] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 586.900320] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.900821] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.900821] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.900947] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.913521] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 587.019751] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.020780] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 587.038537] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.038781] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.038866] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.039122] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.039250] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.039395] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 587.039520] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 587.039620] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 587.057748] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.057965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.058053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.058267] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.058463] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.058608] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 587.075688] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.075896] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.075962] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.076186] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.076321] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.076456] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 587.094103] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.094291] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.094351] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.094576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.094727] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.094879] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 587.094988] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 587.095107] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 587.111970] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.112148] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.112251] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.112520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.112648] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.112786] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 587.112892] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 587.112997] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 587.132827] env[69219]: DEBUG networking_nsxv3.common.locking [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.133094] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.133094] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.133388] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.133536] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.133687] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 587.133796] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 587.133900] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Inventory metadata have been refreshed. [ 587.134009] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Dryrun:True. Metadata refresh completed. [ 587.134136] env[69219]: DEBUG oslo_concurrency.lockutils [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Releasing lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.135867] env[69219]: INFO neutron.agent.agent_extensions_manager [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Loaded agent extensions: [] [ 587.136617] env[69219]: DEBUG neutron_lib.callbacks.manager [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69219) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 587.187223] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent RPC Daemon Started! [ 587.187430] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:0 started [ 587.187515] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent out of sync with plugin! [ 592.137296] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 592.137690] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 597.139247] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 597.139623] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 601.112788] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5878a790-404d-4c8f-9372-b5b17fbd110a demo admin] Enqueued Resource ID: 1434cf3f-764f-4b81-bc49-032821f58405 with Priority: HIGHEST for action security_group_rules [ 601.113516] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1434cf3f-764f-4b81-bc49-032821f58405 with Priority: HIGHEST for action security_group_rules [ 601.113624] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1434cf3f-764f-4b81-bc49-032821f58405 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.113749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1434cf3f-764f-4b81-bc49-032821f58405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.113808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1434cf3f-764f-4b81-bc49-032821f58405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.114155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1434cf3f-764f-4b81-bc49-032821f58405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.114239] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1434cf3f-764f-4b81-bc49-032821f58405',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.634542] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.634781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.634781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.634962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.635057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.635153] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1434cf3f-764f-4b81-bc49-032821f58405 already deleted. [ 601.635234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1434cf3f-764f-4b81-bc49-032821f58405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.115104] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 606.115538] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 611.117303] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 611.117557] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 616.118997] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 616.119383] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 616.138990] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.139179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.139240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.139426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.139646] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.642638] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.144561] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.647137] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 617.647353] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 618.341473] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.341968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.341968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.341968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.352553] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 618.353346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.354106] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 618.371174] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.371337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.371381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.371556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.371632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.371737] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 618.371810] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 618.371880] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 618.392891] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.393071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.393117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.393285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.393413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.393516] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 618.415936] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.416135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.416210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.416364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.416466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.416572] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 618.434543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.434695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.434735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.434895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.435011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.435129] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 618.435201] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 618.435271] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 618.452312] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.452452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.452492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.452648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.452730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.452828] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 618.452898] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 618.452969] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 618.473071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.473195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.473239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.473404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.473496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.473623] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 618.473698] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 618.473767] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 618.473821] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 618.473896] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 618.473954] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 618.474029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 618.474287] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 618.474343] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 618.474413] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 618.494527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.494645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.494730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.494860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.494957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.495069] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 618.512986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.513208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.513208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.513366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.513479] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.542082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.120947] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 621.121323] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 625.695775] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2ba18dce-deb5-4b12-852e-0d08e8a4466d None None] Enqueued Resource ID: 08f2190c-2826-4220-902a-ea703928f3ed with Priority: HIGHEST for action port [ 625.696768] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f2190c-2826-4220-902a-ea703928f3ed with Priority: HIGHEST for action port [ 625.696768] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-08f2190c-2826-4220-902a-ea703928f3ed taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.696768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08f2190c-2826-4220-902a-ea703928f3ed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.697070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08f2190c-2826-4220-902a-ea703928f3ed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.698467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08f2190c-2826-4220-902a-ea703928f3ed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.699452] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08f2190c-2826-4220-902a-ea703928f3ed',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.201629] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08f2190c-2826-4220-902a-ea703928f3ed [ 626.201867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.202010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.202088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.202303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.202395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.202975] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08f2190c-2826-4220-902a-ea703928f3ed already deleted. [ 626.202975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08f2190c-2826-4220-902a-ea703928f3ed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.595534] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2ad2b3ae-4028-4da3-aeeb-d02fc87d8356 None None] Enqueued Resource ID: d7e359b9-87c7-476d-82f3-80e5d5fda4f7 with Priority: HIGHEST for action port [ 627.596472] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7e359b9-87c7-476d-82f3-80e5d5fda4f7 with Priority: HIGHEST for action port [ 627.597176] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7e359b9-87c7-476d-82f3-80e5d5fda4f7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.597347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7e359b9-87c7-476d-82f3-80e5d5fda4f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.597764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7e359b9-87c7-476d-82f3-80e5d5fda4f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.598090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7e359b9-87c7-476d-82f3-80e5d5fda4f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.598213] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e359b9-87c7-476d-82f3-80e5d5fda4f7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.731496] env[69219]: INFO networking_nsxv3.common.synchronization [None req-6f7a0757-adde-46e3-82ce-bc8faf18fa97 None None] Enqueued Resource ID: 9d65d1c6-5c58-4a0c-bba6-c1de5272def6 with Priority: HIGHEST for action port [ 627.731990] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d65d1c6-5c58-4a0c-bba6-c1de5272def6 with Priority: HIGHEST for action port [ 627.732290] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d65d1c6-5c58-4a0c-bba6-c1de5272def6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.732417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d65d1c6-5c58-4a0c-bba6-c1de5272def6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.732485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d65d1c6-5c58-4a0c-bba6-c1de5272def6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.732730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d65d1c6-5c58-4a0c-bba6-c1de5272def6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.732977] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d65d1c6-5c58-4a0c-bba6-c1de5272def6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.101262] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7e359b9-87c7-476d-82f3-80e5d5fda4f7 [ 628.101510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.101652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.101730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.101947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.102052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.102157] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7e359b9-87c7-476d-82f3-80e5d5fda4f7 already deleted. [ 628.102241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7e359b9-87c7-476d-82f3-80e5d5fda4f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.192011] env[69219]: INFO networking_nsxv3.common.synchronization [None req-1dd7415b-2484-4b6c-b2a3-4d9c0199c837 None None] Enqueued Resource ID: 96662446-e03b-4a6f-bb20-63e1e6c902f6 with Priority: HIGHEST for action port [ 628.193146] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96662446-e03b-4a6f-bb20-63e1e6c902f6 with Priority: HIGHEST for action port [ 628.193687] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-96662446-e03b-4a6f-bb20-63e1e6c902f6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.193948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96662446-e03b-4a6f-bb20-63e1e6c902f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.194677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96662446-e03b-4a6f-bb20-63e1e6c902f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.194981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96662446-e03b-4a6f-bb20-63e1e6c902f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.195151] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96662446-e03b-4a6f-bb20-63e1e6c902f6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.236264] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d65d1c6-5c58-4a0c-bba6-c1de5272def6 [ 628.236506] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.236648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.236720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.236937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.237044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.237141] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d65d1c6-5c58-4a0c-bba6-c1de5272def6 already deleted. [ 628.237224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d65d1c6-5c58-4a0c-bba6-c1de5272def6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.697381] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96662446-e03b-4a6f-bb20-63e1e6c902f6 [ 628.697628] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.697779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.697847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.698081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.698175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.698272] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96662446-e03b-4a6f-bb20-63e1e6c902f6 already deleted. [ 628.698355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96662446-e03b-4a6f-bb20-63e1e6c902f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.900036] env[69219]: INFO networking_nsxv3.common.synchronization [None req-ba4033e5-6a65-411f-9cd0-85fc834fb2ee None None] Enqueued Resource ID: 33827728-2055-42c0-8552-06b5781c2b9c with Priority: HIGHEST for action port [ 629.900306] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33827728-2055-42c0-8552-06b5781c2b9c with Priority: HIGHEST for action port [ 629.901434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-33827728-2055-42c0-8552-06b5781c2b9c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.901626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33827728-2055-42c0-8552-06b5781c2b9c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.901742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33827728-2055-42c0-8552-06b5781c2b9c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.902239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33827728-2055-42c0-8552-06b5781c2b9c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.902349] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33827728-2055-42c0-8552-06b5781c2b9c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.179156] env[69219]: INFO networking_nsxv3.common.synchronization [None req-db62cfae-cc2a-4e41-a379-6ca87d56184c None None] Enqueued Resource ID: 9a7235f7-dd5a-4a08-afd8-485c00866913 with Priority: HIGHEST for action port [ 630.179495] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a7235f7-dd5a-4a08-afd8-485c00866913 with Priority: HIGHEST for action port [ 630.179831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a7235f7-dd5a-4a08-afd8-485c00866913 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.179905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a7235f7-dd5a-4a08-afd8-485c00866913" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.179972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a7235f7-dd5a-4a08-afd8-485c00866913" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.180260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a7235f7-dd5a-4a08-afd8-485c00866913" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.180342] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a7235f7-dd5a-4a08-afd8-485c00866913',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.405108] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33827728-2055-42c0-8552-06b5781c2b9c [ 630.405355] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.407829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.407829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.407829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.407829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.407829] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33827728-2055-42c0-8552-06b5781c2b9c already deleted. [ 630.407829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33827728-2055-42c0-8552-06b5781c2b9c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.683698] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a7235f7-dd5a-4a08-afd8-485c00866913 [ 630.684149] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.684149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.684282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.684438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.684530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.684673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a7235f7-dd5a-4a08-afd8-485c00866913 already deleted. [ 630.684735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a7235f7-dd5a-4a08-afd8-485c00866913" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.914032] env[69219]: INFO networking_nsxv3.common.synchronization [None req-71b8964e-b0fe-410b-9dee-4468dffbe583 None None] Enqueued Resource ID: e536e698-2e41-47d9-8e1a-6288877187ac with Priority: HIGHEST for action port [ 632.914032] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e536e698-2e41-47d9-8e1a-6288877187ac with Priority: HIGHEST for action port [ 632.914032] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e536e698-2e41-47d9-8e1a-6288877187ac taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.914032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e536e698-2e41-47d9-8e1a-6288877187ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.914032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e536e698-2e41-47d9-8e1a-6288877187ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.914032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e536e698-2e41-47d9-8e1a-6288877187ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.914032] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e536e698-2e41-47d9-8e1a-6288877187ac',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.016425] env[69219]: INFO networking_nsxv3.common.synchronization [None req-05d229a7-13d8-4f18-9631-9bf81442048c None None] Enqueued Resource ID: 932f01eb-482f-444e-8f2c-6f3be1a566cf with Priority: HIGHEST for action port [ 633.017045] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 932f01eb-482f-444e-8f2c-6f3be1a566cf with Priority: HIGHEST for action port [ 633.017675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-932f01eb-482f-444e-8f2c-6f3be1a566cf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.017900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-932f01eb-482f-444e-8f2c-6f3be1a566cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.018040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-932f01eb-482f-444e-8f2c-6f3be1a566cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.018775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-932f01eb-482f-444e-8f2c-6f3be1a566cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.019198] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('932f01eb-482f-444e-8f2c-6f3be1a566cf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.418784] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e536e698-2e41-47d9-8e1a-6288877187ac [ 633.419072] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.419212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.419287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.419495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.419584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.419688] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e536e698-2e41-47d9-8e1a-6288877187ac already deleted. [ 633.419772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e536e698-2e41-47d9-8e1a-6288877187ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.521463] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 932f01eb-482f-444e-8f2c-6f3be1a566cf [ 633.521700] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.521853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.524024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.524024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.524024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.524024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:932f01eb-482f-444e-8f2c-6f3be1a566cf already deleted. [ 633.524024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-932f01eb-482f-444e-8f2c-6f3be1a566cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.786463] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5853512e-b035-4fb6-bb6c-a1cdc90a31a1 None None] Enqueued Resource ID: 45e9ed65-5633-4b27-8859-84addba3879f with Priority: HIGHEST for action port [ 633.786619] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45e9ed65-5633-4b27-8859-84addba3879f with Priority: HIGHEST for action port [ 633.787233] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-45e9ed65-5633-4b27-8859-84addba3879f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.787344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45e9ed65-5633-4b27-8859-84addba3879f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.787417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45e9ed65-5633-4b27-8859-84addba3879f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.787691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45e9ed65-5633-4b27-8859-84addba3879f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.787772] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45e9ed65-5633-4b27-8859-84addba3879f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.042781] env[69219]: INFO networking_nsxv3.common.synchronization [None req-bd743aa8-cb1c-4723-9dd3-3642d29e8a75 None None] Enqueued Resource ID: 7e265cd1-7a08-4011-85ea-074071c2641a with Priority: HIGHEST for action port [ 634.043385] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e265cd1-7a08-4011-85ea-074071c2641a with Priority: HIGHEST for action port [ 634.043823] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e265cd1-7a08-4011-85ea-074071c2641a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.043823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e265cd1-7a08-4011-85ea-074071c2641a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.044069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e265cd1-7a08-4011-85ea-074071c2641a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.044192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e265cd1-7a08-4011-85ea-074071c2641a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.044240] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e265cd1-7a08-4011-85ea-074071c2641a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.290310] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45e9ed65-5633-4b27-8859-84addba3879f [ 634.291058] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.291237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.294394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.294394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.294394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.294394] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45e9ed65-5633-4b27-8859-84addba3879f already deleted. [ 634.294394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45e9ed65-5633-4b27-8859-84addba3879f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.539655] env[69219]: INFO networking_nsxv3.common.synchronization [None req-d738692a-7c46-49d2-8a50-22d19032e352 None None] Enqueued Resource ID: 20010e2f-414e-417d-8e18-c7710c827e1c with Priority: HIGHEST for action port [ 634.539906] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20010e2f-414e-417d-8e18-c7710c827e1c with Priority: HIGHEST for action port [ 634.541178] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-20010e2f-414e-417d-8e18-c7710c827e1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.541178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20010e2f-414e-417d-8e18-c7710c827e1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.541178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20010e2f-414e-417d-8e18-c7710c827e1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.541178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20010e2f-414e-417d-8e18-c7710c827e1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.541178] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20010e2f-414e-417d-8e18-c7710c827e1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.547884] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e265cd1-7a08-4011-85ea-074071c2641a [ 634.547884] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.547884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.547884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.547884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.547884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.547884] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e265cd1-7a08-4011-85ea-074071c2641a already deleted. [ 634.547884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e265cd1-7a08-4011-85ea-074071c2641a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.043819] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20010e2f-414e-417d-8e18-c7710c827e1c [ 635.044178] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.044280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.044280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.044492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.044584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.044679] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20010e2f-414e-417d-8e18-c7710c827e1c already deleted. [ 635.044755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20010e2f-414e-417d-8e18-c7710c827e1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.653125] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4ba2fe04-9f01-4329-8449-2b4eade22ceb None None] Enqueued Resource ID: d1078715-8703-4289-acfd-06b0631b0277 with Priority: HIGHEST for action port [ 635.653392] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1078715-8703-4289-acfd-06b0631b0277 with Priority: HIGHEST for action port [ 635.654046] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1078715-8703-4289-acfd-06b0631b0277 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.654173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1078715-8703-4289-acfd-06b0631b0277" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.654288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1078715-8703-4289-acfd-06b0631b0277" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.654606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1078715-8703-4289-acfd-06b0631b0277" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.654856] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1078715-8703-4289-acfd-06b0631b0277',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.862300] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5729f9b3-28cc-4a2e-a978-ca2a323efa0f None None] Enqueued Resource ID: 7f4c15bc-5779-4ee9-8913-22a8f5164015 with Priority: HIGHEST for action port [ 635.864840] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4c15bc-5779-4ee9-8913-22a8f5164015 with Priority: HIGHEST for action port [ 635.864840] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f4c15bc-5779-4ee9-8913-22a8f5164015 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.864840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f4c15bc-5779-4ee9-8913-22a8f5164015" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.864840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f4c15bc-5779-4ee9-8913-22a8f5164015" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.865130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f4c15bc-5779-4ee9-8913-22a8f5164015" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.866149] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f4c15bc-5779-4ee9-8913-22a8f5164015',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.156672] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1078715-8703-4289-acfd-06b0631b0277 [ 636.157418] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.158193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.158193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.158414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.159416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.159416] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1078715-8703-4289-acfd-06b0631b0277 already deleted. [ 636.159416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1078715-8703-4289-acfd-06b0631b0277" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.368036] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f4c15bc-5779-4ee9-8913-22a8f5164015 [ 636.368314] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.368447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.368515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.369293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.369293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.369293] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f4c15bc-5779-4ee9-8913-22a8f5164015 already deleted. [ 636.369293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f4c15bc-5779-4ee9-8913-22a8f5164015" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.829271] env[69219]: INFO networking_nsxv3.common.synchronization [None req-3361b75c-5662-49c9-a582-bfcd4f0bca77 None None] Enqueued Resource ID: 31f1a3d3-ae0b-4cb5-8dba-5449650e9861 with Priority: HIGHEST for action port [ 636.829779] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31f1a3d3-ae0b-4cb5-8dba-5449650e9861 with Priority: HIGHEST for action port [ 636.830095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-31f1a3d3-ae0b-4cb5-8dba-5449650e9861 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.830220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31f1a3d3-ae0b-4cb5-8dba-5449650e9861" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.830290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31f1a3d3-ae0b-4cb5-8dba-5449650e9861" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.830561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31f1a3d3-ae0b-4cb5-8dba-5449650e9861" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.830643] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31f1a3d3-ae0b-4cb5-8dba-5449650e9861',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.557830] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31f1a3d3-ae0b-4cb5-8dba-5449650e9861 [ 637.558544] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.558544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.558544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.558544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.558916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.558916] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31f1a3d3-ae0b-4cb5-8dba-5449650e9861 already deleted. [ 637.558916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31f1a3d3-ae0b-4cb5-8dba-5449650e9861" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.280098] env[69219]: INFO networking_nsxv3.common.synchronization [None req-84924257-1a1e-4e35-9557-6bb3f7354709 None None] Enqueued Resource ID: 451f6ba3-d850-427e-bcb2-89712da16a5f with Priority: HIGHEST for action port [ 638.280098] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 451f6ba3-d850-427e-bcb2-89712da16a5f with Priority: HIGHEST for action port [ 638.280098] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-451f6ba3-d850-427e-bcb2-89712da16a5f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.280098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-451f6ba3-d850-427e-bcb2-89712da16a5f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.280098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-451f6ba3-d850-427e-bcb2-89712da16a5f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.280098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-451f6ba3-d850-427e-bcb2-89712da16a5f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.280098] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('451f6ba3-d850-427e-bcb2-89712da16a5f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.627032] env[69219]: INFO networking_nsxv3.common.synchronization [None req-70d54b98-2fd3-4c6f-8df8-5da479150c98 None None] Enqueued Resource ID: 1713f940-a79c-4fa2-901b-f34833340b34 with Priority: HIGHEST for action port [ 638.627032] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1713f940-a79c-4fa2-901b-f34833340b34 with Priority: HIGHEST for action port [ 638.627032] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-1713f940-a79c-4fa2-901b-f34833340b34 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.627032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1713f940-a79c-4fa2-901b-f34833340b34" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.627032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1713f940-a79c-4fa2-901b-f34833340b34" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.627032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1713f940-a79c-4fa2-901b-f34833340b34" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.627032] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1713f940-a79c-4fa2-901b-f34833340b34',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.757329] env[69219]: INFO networking_nsxv3.common.synchronization [req-242d42f5-d922-4294-89b1-cafcca1c3091 req-cbdeee05-0dcb-4e80-987f-b92d13c8ad08 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 638.757329] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 638.757329] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.757329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.757329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.757329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.762269] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.762269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.762269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.762269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.762269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.762269] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.783787] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 451f6ba3-d850-427e-bcb2-89712da16a5f [ 638.783787] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.783787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.783787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.784365] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.784365] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.784514] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:451f6ba3-d850-427e-bcb2-89712da16a5f already deleted. [ 638.784581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-451f6ba3-d850-427e-bcb2-89712da16a5f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.940583] env[69219]: INFO networking_nsxv3.common.synchronization [None req-52a59c5b-eb9e-4639-9aa0-e8c86ba28455 None None] Enqueued Resource ID: 1c4b086c-b7d0-4972-8c06-bc203657b8cf with Priority: HIGHEST for action port [ 638.940833] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c4b086c-b7d0-4972-8c06-bc203657b8cf with Priority: HIGHEST for action port [ 638.941688] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c4b086c-b7d0-4972-8c06-bc203657b8cf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.941688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c4b086c-b7d0-4972-8c06-bc203657b8cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.941688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c4b086c-b7d0-4972-8c06-bc203657b8cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.941861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c4b086c-b7d0-4972-8c06-bc203657b8cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.941908] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c4b086c-b7d0-4972-8c06-bc203657b8cf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.134831] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1713f940-a79c-4fa2-901b-f34833340b34 [ 639.134831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.134831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.134831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.134831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.134831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.134831] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1713f940-a79c-4fa2-901b-f34833340b34 already deleted. [ 639.134831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1713f940-a79c-4fa2-901b-f34833340b34" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.264445] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.264608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.264691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.264920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.265061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.268219] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.268219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.268219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.268219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.268219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.268219] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 already deleted. [ 639.268219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.445390] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c4b086c-b7d0-4972-8c06-bc203657b8cf [ 639.446657] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.446657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.446657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.446657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.446657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.446657] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c4b086c-b7d0-4972-8c06-bc203657b8cf already deleted. [ 639.446657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c4b086c-b7d0-4972-8c06-bc203657b8cf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.738932] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8ea89d98-8c0a-453f-966d-d8dee802a369 None None] Enqueued Resource ID: f423e14b-e21b-4c4d-83b7-be7aafccf5b1 with Priority: HIGHEST for action port [ 639.739294] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f423e14b-e21b-4c4d-83b7-be7aafccf5b1 with Priority: HIGHEST for action port [ 639.739570] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f423e14b-e21b-4c4d-83b7-be7aafccf5b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.739699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f423e14b-e21b-4c4d-83b7-be7aafccf5b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.739752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f423e14b-e21b-4c4d-83b7-be7aafccf5b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.740013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f423e14b-e21b-4c4d-83b7-be7aafccf5b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.740107] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f423e14b-e21b-4c4d-83b7-be7aafccf5b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.762018] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.762018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.762018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.762018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.762018] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.762018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.762018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.764056] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.764128] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.764621] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.764621] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.764748] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.764795] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.766278] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.766278] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.766278] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.783944] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.784105] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.784696] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.784890] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.785296] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c5c881f2-1698-41ac-8754-83c13efdace9 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.785686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.785686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.786034] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.786352] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c881f2-1698-41ac-8754-83c13efdace9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.090125] env[69219]: INFO networking_nsxv3.common.synchronization [None req-34785ef3-5cb0-4cc5-94d1-0ac17077de5a None None] Enqueued Resource ID: 7e5cb33a-4147-497f-8705-9b6e02bad0ab with Priority: HIGHEST for action port [ 640.090767] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5cb33a-4147-497f-8705-9b6e02bad0ab with Priority: HIGHEST for action port [ 640.091190] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5cb33a-4147-497f-8705-9b6e02bad0ab taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.091322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5cb33a-4147-497f-8705-9b6e02bad0ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.091394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5cb33a-4147-497f-8705-9b6e02bad0ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.091769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5cb33a-4147-497f-8705-9b6e02bad0ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.091769] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5cb33a-4147-497f-8705-9b6e02bad0ab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.242976] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f423e14b-e21b-4c4d-83b7-be7aafccf5b1 [ 640.244211] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.244211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.244211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.244211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.244387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.244387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f423e14b-e21b-4c4d-83b7-be7aafccf5b1 already deleted. [ 640.244449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f423e14b-e21b-4c4d-83b7-be7aafccf5b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.289700] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.289946] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.290183] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.290492] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.290653] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.290818] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c5c881f2-1698-41ac-8754-83c13efdace9 not found, creating... [ 640.291183] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.291314] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.291389] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.291606] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.291859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.292125] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.292293] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.292416] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.292630] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.292772] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.292918] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c5c881f2-1698-41ac-8754-83c13efdace9 is going to be created. [ 640.322146] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.322359] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.322488] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.322882] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.322983] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.323307] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.593734] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e5cb33a-4147-497f-8705-9b6e02bad0ab [ 640.596157] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.596316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.596388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.597089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.597227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.597331] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e5cb33a-4147-497f-8705-9b6e02bad0ab already deleted. [ 640.597415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5cb33a-4147-497f-8705-9b6e02bad0ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.740229] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7c7aae23-ea4c-46eb-8c55-55007b643a0e None None] Enqueued Resource ID: d42c1bfa-d136-4e7a-a08a-90e5b3491fd9 with Priority: HIGHEST for action port [ 640.740616] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d42c1bfa-d136-4e7a-a08a-90e5b3491fd9 with Priority: HIGHEST for action port [ 640.741032] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d42c1bfa-d136-4e7a-a08a-90e5b3491fd9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.741112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d42c1bfa-d136-4e7a-a08a-90e5b3491fd9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.741205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d42c1bfa-d136-4e7a-a08a-90e5b3491fd9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.742994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d42c1bfa-d136-4e7a-a08a-90e5b3491fd9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.742994] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42c1bfa-d136-4e7a-a08a-90e5b3491fd9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.195703] env[69219]: INFO networking_nsxv3.common.synchronization [None req-b32c230a-f601-42b1-8c8f-2c57ac796e17 None None] Enqueued Resource ID: e8ecbd15-7679-4df1-a9bd-702ba3c71879 with Priority: HIGHEST for action port [ 641.195960] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8ecbd15-7679-4df1-a9bd-702ba3c71879 with Priority: HIGHEST for action port [ 641.197853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8ecbd15-7679-4df1-a9bd-702ba3c71879 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.198043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8ecbd15-7679-4df1-a9bd-702ba3c71879" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.198115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8ecbd15-7679-4df1-a9bd-702ba3c71879" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.198403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8ecbd15-7679-4df1-a9bd-702ba3c71879" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.198494] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8ecbd15-7679-4df1-a9bd-702ba3c71879',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.246191] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d42c1bfa-d136-4e7a-a08a-90e5b3491fd9 [ 641.246463] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.246570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.246702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.246954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.247063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.247509] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d42c1bfa-d136-4e7a-a08a-90e5b3491fd9 already deleted. [ 641.247614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d42c1bfa-d136-4e7a-a08a-90e5b3491fd9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.433050] env[69219]: INFO networking_nsxv3.common.synchronization [req-242d42f5-d922-4294-89b1-cafcca1c3091 req-3f588cf4-2f55-4de9-957d-b4d46075dcd7 service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 641.433821] env[69219]: INFO networking_nsxv3.common.synchronization [req-242d42f5-d922-4294-89b1-cafcca1c3091 req-3f588cf4-2f55-4de9-957d-b4d46075dcd7 service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 641.433821] env[69219]: INFO networking_nsxv3.common.synchronization [req-242d42f5-d922-4294-89b1-cafcca1c3091 req-3f588cf4-2f55-4de9-957d-b4d46075dcd7 service nova] Enqueued Resource ID: c5c881f2-1698-41ac-8754-83c13efdace9 with Priority: HIGHEST for action port [ 641.433821] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 641.433821] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 641.433821] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c881f2-1698-41ac-8754-83c13efdace9 with Priority: HIGHEST for action port [ 641.434755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.434755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.435024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.435191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.435279] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.438079] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.438206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.438271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.438751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.438751] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.438751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.438977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.438977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.439084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.439161] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.442325] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5c881f2-1698-41ac-8754-83c13efdace9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.442325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.442325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.442325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.442325] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5c881f2-1698-41ac-8754-83c13efdace9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.701363] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8ecbd15-7679-4df1-a9bd-702ba3c71879 [ 641.702551] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.702551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.702551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.702551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.702551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.702551] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8ecbd15-7679-4df1-a9bd-702ba3c71879 already deleted. [ 641.702551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8ecbd15-7679-4df1-a9bd-702ba3c71879" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.944700] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.944955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.959391] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5c881f2-1698-41ac-8754-83c13efdace9 with status ACTIVE [ 641.959613] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.959807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.959807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.961115] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.961115] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.961115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.961485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.961485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.961485] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5c881f2-1698-41ac-8754-83c13efdace9 is going to be updated. [ 641.962462] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.985015] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.985015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.985189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.985226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.985414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.986389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5c881f2-1698-41ac-8754-83c13efdace9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.027579] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c5c0e6b6-c2b0-4eb2-8eb1-98549ecd8a4b tempest-ServersTestJSON-212915453 tempest-ServersTestJSON-212915453-project-member] Enqueued Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_rules [ 642.030140] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_rules [ 642.030722] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.030880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.030984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.031235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.031292] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.286526] env[69219]: INFO networking_nsxv3.common.synchronization [None req-50c99dc0-0db8-4e87-bebc-b2cdd68c31e9 tempest-ServersTestJSON-212915453 tempest-ServersTestJSON-212915453-project-member] Enqueued Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_rules [ 642.287107] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_rules [ 642.287403] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.287506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.465064] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.558205] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.558205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.558205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.558205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.558205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.558205] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 already deleted. [ 642.558205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.558205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.558205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.558205] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.968153] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.968356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.968356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.968616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.968616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.969723] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be created. [ 643.021370] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.021509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.021595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.021780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.021975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.031544] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: UNINITIALIZED for 2s [ 643.083755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.083912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.083990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.084230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.084452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.084452] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 already deleted. [ 643.084562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.147229] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-4ceedee3-9dfe-45db-bb63-48dc4cbee4cc tempest-ListServersNegativeTestJSON-476691794 tempest-ListServersNegativeTestJSON-476691794-project-member] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 643.147229] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 643.147523] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.149833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.149914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.150236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.150429] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.150530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.150593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.150747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.150827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.150920] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.176163] env[69219]: INFO networking_nsxv3.common.synchronization [None req-3247beb6-ed0d-4072-a409-34ab4669b2a2 None None] Enqueued Resource ID: 0516337e-fdbc-4749-bd1d-dbf0898f98c1 with Priority: HIGHEST for action port [ 643.176413] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0516337e-fdbc-4749-bd1d-dbf0898f98c1 with Priority: HIGHEST for action port [ 643.176963] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0516337e-fdbc-4749-bd1d-dbf0898f98c1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.177095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0516337e-fdbc-4749-bd1d-dbf0898f98c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.177160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0516337e-fdbc-4749-bd1d-dbf0898f98c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.177398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0516337e-fdbc-4749-bd1d-dbf0898f98c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.177475] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0516337e-fdbc-4749-bd1d-dbf0898f98c1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.653976] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.653976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.653976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.654656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.654777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.654934] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.655115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.655628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.655811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.655899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.656018] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d already deleted. [ 643.656180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.672520] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-528 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.672683] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.672752] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.673075] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.673347] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.673509] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.673628] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.676049] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.676220] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.676506] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.676706] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.679980] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.679980] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.679980] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.679980] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.680166] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.681844] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0516337e-fdbc-4749-bd1d-dbf0898f98c1 [ 643.682549] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.682549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.682549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.682549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.682549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.682549] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0516337e-fdbc-4749-bd1d-dbf0898f98c1 already deleted. [ 643.682794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0516337e-fdbc-4749-bd1d-dbf0898f98c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.699500] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.699661] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.699965] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.699965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.700323] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.700513] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.700628] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.700973] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.701313] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a42661f-b71d-44a5-bfe8-5f75dd30b5e0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.203658] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.203965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.204086] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.204322] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.204485] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.204642] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 not found, creating... [ 644.204903] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.205085] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.205207] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.205462] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.205606] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.205894] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.207384] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.208322] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.208322] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.208854] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.209315] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 is going to be created. [ 644.233464] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.233672] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.233796] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.234081] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.234598] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.235161] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.041589] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 645.041589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.041758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.041951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.042175] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.042299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.042364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.042521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.042627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.042735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.042847] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.416425] env[69219]: INFO networking_nsxv3.common.synchronization [None req-cfbd6b17-bd0b-497a-b49f-7990340c3ceb tempest-VolumesAssistedSnapshotsTest-1735245712 tempest-VolumesAssistedSnapshotsTest-1735245712-project-member] Enqueued Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_rules [ 645.417020] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_rules [ 645.417347] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.417500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.417551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.417785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.417879] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.547726] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.547726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.547876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.548058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.548242] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.548454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.548454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.549251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.549251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.549251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.549251] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.549251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.549251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.549251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.549471] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.549471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.549471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.549566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.549863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.549863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.549863] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.671183] env[69219]: INFO networking_nsxv3.common.synchronization [None req-3ae916c2-a39e-4aeb-9aec-e1eb7afc3f74 None None] Enqueued Resource ID: cdf4e7d4-6083-4f32-84da-d76039f63885 with Priority: HIGHEST for action port [ 645.671183] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf4e7d4-6083-4f32-84da-d76039f63885 with Priority: HIGHEST for action port [ 645.671601] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdf4e7d4-6083-4f32-84da-d76039f63885 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.671676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdf4e7d4-6083-4f32-84da-d76039f63885" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.671795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdf4e7d4-6083-4f32-84da-d76039f63885" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.672020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdf4e7d4-6083-4f32-84da-d76039f63885" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.673119] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf4e7d4-6083-4f32-84da-d76039f63885',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.688209] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-098268ea-638e-42f2-9663-02879bd075e9 tempest-ListServersNegativeTestJSON-476691794 tempest-ListServersNegativeTestJSON-476691794-project-member] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 645.689623] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 645.689623] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.689731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.689731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.690159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.690345] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.690464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.690529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.690696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.691562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.691562] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.880159] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c1558343-a947-4517-b3f3-4ad13c6780c3 tempest-VolumesAssistedSnapshotsTest-1735245712 tempest-VolumesAssistedSnapshotsTest-1735245712-project-member] Enqueued Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_rules [ 645.881970] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_rules [ 645.881970] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.881970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.937040] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.937209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.937266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.937486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.937857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.938012] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6f62def-0bf8-403b-b778-966080958ecc already deleted. [ 645.938077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.939260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.939260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.939379] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.059020] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03b383a8-62e8-454b-9d3c-ac3de2f9ba05: rpc.has_security_group_logging(os_id): False [ 646.063683] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-f065ada6-390c-4676-afcb-88f1e747ed68 service nova] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_rules [ 646.063868] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-f065ada6-390c-4676-afcb-88f1e747ed68 service nova] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 646.064016] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-f065ada6-390c-4676-afcb-88f1e747ed68 service nova] Enqueued Resource ID: 4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 with Priority: HIGHEST for action port [ 646.064279] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_rules [ 646.064407] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 646.064506] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 with Priority: HIGHEST for action port [ 646.065372] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.065526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.065625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.066043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.066133] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.067417] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.067582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.068073] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.068073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.068193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.068303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.068425] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a42661f-b71d-44a5-bfe8-5f75dd30b5e0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.072575] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.072575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.072575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.073191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.073191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.073293] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.073352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.074461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.074662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.074767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.074947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.075068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.075132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.075273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.075417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.075668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.075789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.075825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.075971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.076064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.076526] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be created. [ 646.139162] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.139162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.139381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.139934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.139934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.152608] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 646.177696] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdf4e7d4-6083-4f32-84da-d76039f63885 [ 646.177696] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.179422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.179422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.179422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.179422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.179422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdf4e7d4-6083-4f32-84da-d76039f63885 already deleted. [ 646.179422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdf4e7d4-6083-4f32-84da-d76039f63885" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.196028] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.393255] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-528 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.393255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.393255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.393255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.397850] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.397850] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.397850] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.397850] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.397850] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.397850] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.397850] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.397850] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.397850] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.397850] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 646.397850] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.397850] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.427369] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.431348] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 646.431793] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.431793] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.432170] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-e4a37925-f925-44e4-9787-8215809ba766 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.432322] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.432526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.432714] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.432890] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4a37925-f925-44e4-9787-8215809ba766',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.460129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.460398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.460398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.461385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.461385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.461385] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6f62def-0bf8-403b-b778-966080958ecc already deleted. [ 646.461385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.570741] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.570860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.587022] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 with status ACTIVE [ 646.587022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.587022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.587022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.587022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.587022] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a42661f-b71d-44a5-bfe8-5f75dd30b5e0 is going to be updated. [ 646.607548] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.607634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.607634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.608775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.608819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.608976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a42661f-b71d-44a5-bfe8-5f75dd30b5e0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.701258] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.938919] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.939199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.939270] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.939568] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.939711] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.939909] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port e4a37925-f925-44e4-9787-8215809ba766 not found, creating... [ 646.940208] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.940365] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.940494] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.941288] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.941288] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.941288] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.941288] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.941615] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.941665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.941777] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.941900] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: e4a37925-f925-44e4-9787-8215809ba766 is going to be created. [ 646.970471] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.970707] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.970869] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.971210] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.971442] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.971675] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.203558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.203748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.203812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.204097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.204197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.204305] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be created. [ 647.231945] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.231945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.231945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.231945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.231945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.241288] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: UNINITIALIZED for 2s [ 647.333601] env[69219]: INFO networking_nsxv3.common.synchronization [None req-61630ffc-5818-4bab-a14c-83154500fda4 None None] Enqueued Resource ID: 7452b985-453a-46f9-b4a0-9f7a43a6f8b8 with Priority: HIGHEST for action port [ 647.333601] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7452b985-453a-46f9-b4a0-9f7a43a6f8b8 with Priority: HIGHEST for action port [ 647.337510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7452b985-453a-46f9-b4a0-9f7a43a6f8b8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.337510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7452b985-453a-46f9-b4a0-9f7a43a6f8b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.337510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7452b985-453a-46f9-b4a0-9f7a43a6f8b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.337510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7452b985-453a-46f9-b4a0-9f7a43a6f8b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.337510] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7452b985-453a-46f9-b4a0-9f7a43a6f8b8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.487051] env[69219]: INFO networking_nsxv3.common.synchronization [None req-b41f13d0-ca65-48c2-be76-d8410bacb7c0 None None] Enqueued Resource ID: 714027f2-d76e-4c1e-a4c5-80c957733527 with Priority: HIGHEST for action port [ 647.487051] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 714027f2-d76e-4c1e-a4c5-80c957733527 with Priority: HIGHEST for action port [ 647.487051] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-714027f2-d76e-4c1e-a4c5-80c957733527 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.487051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-714027f2-d76e-4c1e-a4c5-80c957733527" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.487051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-714027f2-d76e-4c1e-a4c5-80c957733527" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.487933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-714027f2-d76e-4c1e-a4c5-80c957733527" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.488169] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('714027f2-d76e-4c1e-a4c5-80c957733527',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.842067] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7452b985-453a-46f9-b4a0-9f7a43a6f8b8 [ 647.842549] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.843028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.843373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.843731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.845678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.845678] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7452b985-453a-46f9-b4a0-9f7a43a6f8b8 already deleted. [ 647.845678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7452b985-453a-46f9-b4a0-9f7a43a6f8b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.990735] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 714027f2-d76e-4c1e-a4c5-80c957733527 [ 647.990988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.991140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.991206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.991418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.991502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.991595] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:714027f2-d76e-4c1e-a4c5-80c957733527 already deleted. [ 647.991674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-714027f2-d76e-4c1e-a4c5-80c957733527" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.168938] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 648.169352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.214578] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-97c1d13e-3904-494d-a9dd-ff6c91019992 tempest-ListServersNegativeTestJSON-476691794 tempest-ListServersNegativeTestJSON-476691794-project-member] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 648.214805] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 648.217018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.219226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.352203] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-1acd5224-4832-4cd2-8fd3-823086260934 service nova] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_rules [ 648.355327] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-1acd5224-4832-4cd2-8fd3-823086260934 service nova] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 648.355486] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-1acd5224-4832-4cd2-8fd3-823086260934 service nova] Enqueued Resource ID: e4a37925-f925-44e4-9787-8215809ba766 with Priority: HIGHEST for action port [ 648.356053] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_rules [ 648.356335] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 648.356335] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4a37925-f925-44e4-9787-8215809ba766 with Priority: HIGHEST for action port [ 648.356569] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.356666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.356853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.358089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.358089] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4a37925-f925-44e4-9787-8215809ba766 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.358089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.358089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.358349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.358349] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4a37925-f925-44e4-9787-8215809ba766',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.472688] env[69219]: INFO networking_nsxv3.common.synchronization [None req-07504aa8-f030-4713-9093-145400fdb363 None None] Enqueued Resource ID: afdda5e4-d244-4c55-a797-d87bd4563b23 with Priority: HIGHEST for action port [ 648.474976] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afdda5e4-d244-4c55-a797-d87bd4563b23 with Priority: HIGHEST for action port [ 648.475324] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-afdda5e4-d244-4c55-a797-d87bd4563b23 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.475451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afdda5e4-d244-4c55-a797-d87bd4563b23" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.475518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afdda5e4-d244-4c55-a797-d87bd4563b23" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.475802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afdda5e4-d244-4c55-a797-d87bd4563b23" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.475908] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afdda5e4-d244-4c55-a797-d87bd4563b23',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.860417] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4a37925-f925-44e4-9787-8215809ba766 with status ACTIVE [ 648.860765] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.860828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.861558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.861558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.861558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.861558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.861558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.861558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.861853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.861853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.862255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.862255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.862255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.862255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.863537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.863537] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4a37925-f925-44e4-9787-8215809ba766 is going to be updated. [ 648.889395] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.889573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.889617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.889866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.890045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.890216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4a37925-f925-44e4-9787-8215809ba766" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.905711] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-528 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.905711] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.905711] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.905711] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.906026] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.907287] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.907443] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.907834] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.907834] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.908146] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.908232] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.908371] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.908502] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.908619] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.908728] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.908866] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.927483] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.927992] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.928317] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.928651] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-528" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.929533] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-57fc5105-e978-47b9-8d54-5c6394d5d849 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.929779] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.929926] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.930287] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.930434] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57fc5105-e978-47b9-8d54-5c6394d5d849',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.981406] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afdda5e4-d244-4c55-a797-d87bd4563b23 [ 648.981859] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.981859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.982079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.982126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.982220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.982402] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afdda5e4-d244-4c55-a797-d87bd4563b23 already deleted. [ 648.982402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afdda5e4-d244-4c55-a797-d87bd4563b23" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.252805] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 649.253116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.253791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.253791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.253791] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.256276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.256276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.256276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.256276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.256276] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.433079] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.433337] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.433529] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.433903] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.433942] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.434092] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 57fc5105-e978-47b9-8d54-5c6394d5d849 not found, creating... [ 649.434684] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.435191] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.435410] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.435724] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.435980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.436380] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.436836] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.436836] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.437405] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.437673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.438539] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 57fc5105-e978-47b9-8d54-5c6394d5d849 is going to be created. [ 649.458092] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.458350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.458477] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.458762] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.459155] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.459288] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.757463] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.259852] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.476384] env[69219]: INFO networking_nsxv3.common.synchronization [None req-e819cfc3-115f-4431-8ccf-9ccfc26899ff None None] Enqueued Resource ID: 69640890-b415-48fd-916f-00485614ab6a with Priority: HIGHEST for action port [ 650.476384] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69640890-b415-48fd-916f-00485614ab6a with Priority: HIGHEST for action port [ 650.478780] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-69640890-b415-48fd-916f-00485614ab6a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.479125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69640890-b415-48fd-916f-00485614ab6a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.480145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69640890-b415-48fd-916f-00485614ab6a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.480145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69640890-b415-48fd-916f-00485614ab6a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.480145] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69640890-b415-48fd-916f-00485614ab6a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.556022] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2b4d0f12-081d-4673-bc0d-d6514733ad89 None None] Enqueued Resource ID: 90e75551-172b-48fe-bde5-f60233a72b8b with Priority: HIGHEST for action port [ 650.556022] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90e75551-172b-48fe-bde5-f60233a72b8b with Priority: HIGHEST for action port [ 650.556022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-90e75551-172b-48fe-bde5-f60233a72b8b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.557535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90e75551-172b-48fe-bde5-f60233a72b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.557535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90e75551-172b-48fe-bde5-f60233a72b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.557535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90e75551-172b-48fe-bde5-f60233a72b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.557535] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90e75551-172b-48fe-bde5-f60233a72b8b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.765119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.765119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.765119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.765119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.765119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.765119] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 650.794052] env[69219]: INFO networking_nsxv3.common.synchronization [req-6a870b34-2976-4136-9d0f-feed6e860447 req-6ed74cf3-99f5-4b67-acde-3475fd96eeb5 tempest-ServersAdminNegativeTestJSON-713106145 tempest-ServersAdminNegativeTestJSON-713106145-project-member] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 650.794052] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 650.794052] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.794052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.794052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.794052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.794052] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.795441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.795659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.795925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.796134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.796322] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.802231] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.802400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.802477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.803070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.803070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.810996] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 650.869066] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-36fae54e-cd05-4ca3-98d8-258a0d29ebc1 service nova] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_rules [ 650.869231] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-36fae54e-cd05-4ca3-98d8-258a0d29ebc1 service nova] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 650.869845] env[69219]: INFO networking_nsxv3.common.synchronization [req-fd60ef28-cbaf-42e6-a6df-1f92bf4c707f req-36fae54e-cd05-4ca3-98d8-258a0d29ebc1 service nova] Enqueued Resource ID: 57fc5105-e978-47b9-8d54-5c6394d5d849 with Priority: HIGHEST for action port [ 650.869845] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_rules [ 650.869845] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 650.869845] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fc5105-e978-47b9-8d54-5c6394d5d849 with Priority: HIGHEST for action port [ 650.871574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.871574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.871574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.871574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.871574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-57fc5105-e978-47b9-8d54-5c6394d5d849 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.871574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.872168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.872741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.872741] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57fc5105-e978-47b9-8d54-5c6394d5d849',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.983304] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69640890-b415-48fd-916f-00485614ab6a [ 650.983518] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.983648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.983714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.983938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.984041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.984136] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69640890-b415-48fd-916f-00485614ab6a already deleted. [ 650.984216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69640890-b415-48fd-916f-00485614ab6a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.058998] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90e75551-172b-48fe-bde5-f60233a72b8b [ 651.059095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.059296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.059296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.059530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.059530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.059670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90e75551-172b-48fe-bde5-f60233a72b8b already deleted. [ 651.059706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90e75551-172b-48fe-bde5-f60233a72b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.298976] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.299313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.299313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.299799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.299799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.299799] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.300117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.300117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.300117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.300267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.300267] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 already deleted. [ 651.300363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.375478] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57fc5105-e978-47b9-8d54-5c6394d5d849 with status ACTIVE [ 651.375689] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.377355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.377456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.377730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.377796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.378119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.378196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.378196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.378361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.379021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.379021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.379021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.379021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.379021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.379232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.379232] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57fc5105-e978-47b9-8d54-5c6394d5d849 is going to be updated. [ 651.407498] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.407738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.407738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.407961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.408108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.408291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57fc5105-e978-47b9-8d54-5c6394d5d849" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.423553] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.423743] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.423863] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.424206] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.424458] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.424612] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.424727] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.424985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.425539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.425752] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.425864] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.425974] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.426098] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.426209] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 651.426313] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.426572] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.446062] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.446244] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 651.446382] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.446596] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.447085] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9a465952-674f-435c-85cf-3d38dcbd3d64 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.447219] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.447263] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.447668] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.447719] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a465952-674f-435c-85cf-3d38dcbd3d64',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.785128] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5def3340-b6dc-4412-9da2-8ad15243e3d4 None None] Enqueued Resource ID: bc2476d6-4de0-49c2-8ddf-91622c326435 with Priority: HIGHEST for action port [ 651.785805] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc2476d6-4de0-49c2-8ddf-91622c326435 with Priority: HIGHEST for action port [ 651.786052] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc2476d6-4de0-49c2-8ddf-91622c326435 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.786254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc2476d6-4de0-49c2-8ddf-91622c326435" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.786254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc2476d6-4de0-49c2-8ddf-91622c326435" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.786431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc2476d6-4de0-49c2-8ddf-91622c326435" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.786530] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc2476d6-4de0-49c2-8ddf-91622c326435',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.951814] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.952241] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.952325] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.952928] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.952928] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.953526] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9a465952-674f-435c-85cf-3d38dcbd3d64 not found, creating... [ 651.954499] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.954499] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.954499] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.954499] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.955023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.955023] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.955109] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.955324] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.955405] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.955576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.955680] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9a465952-674f-435c-85cf-3d38dcbd3d64 is going to be created. [ 651.975745] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.976053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.976294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.976384] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.976621] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.976833] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.289193] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc2476d6-4de0-49c2-8ddf-91622c326435 [ 652.289451] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.289772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.289877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.290140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.290242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.290347] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc2476d6-4de0-49c2-8ddf-91622c326435 already deleted. [ 652.290457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc2476d6-4de0-49c2-8ddf-91622c326435" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.821557] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 652.821827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.822335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.822581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.822797] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.822927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.822990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.823164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.823246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.823349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.823427] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.824354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.824548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.824712] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.824814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.824875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.825028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.825108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.825194] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.330860] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.330860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.331855] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.524441] env[69219]: INFO networking_nsxv3.common.synchronization [req-6a870b34-2976-4136-9d0f-feed6e860447 req-4744af84-274b-4d3b-adea-6e22859e806b service nova] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_rules [ 653.525059] env[69219]: INFO networking_nsxv3.common.synchronization [req-6a870b34-2976-4136-9d0f-feed6e860447 req-4744af84-274b-4d3b-adea-6e22859e806b service nova] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 653.525059] env[69219]: INFO networking_nsxv3.common.synchronization [req-6a870b34-2976-4136-9d0f-feed6e860447 req-4744af84-274b-4d3b-adea-6e22859e806b service nova] Enqueued Resource ID: 9a465952-674f-435c-85cf-3d38dcbd3d64 with Priority: HIGHEST for action port [ 653.525059] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_rules [ 653.525220] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 653.525220] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a465952-674f-435c-85cf-3d38dcbd3d64 with Priority: HIGHEST for action port [ 653.525821] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.526069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.526069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.526226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.526362] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.527156] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.527301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.527345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.527509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.527653] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.527747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.527798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.527950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.528046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.528139] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.528922] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a465952-674f-435c-85cf-3d38dcbd3d64 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.529044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.529086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.529232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.529306] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a465952-674f-435c-85cf-3d38dcbd3d64',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.839477] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.031121] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.031357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.031700] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.032547] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a465952-674f-435c-85cf-3d38dcbd3d64 with status ACTIVE [ 654.032740] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.032855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.033062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.033330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.033443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.033599] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.033698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.033765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.033917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.033996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.034334] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.034429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.034481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.034608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.034740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.034848] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a465952-674f-435c-85cf-3d38dcbd3d64 is going to be updated. [ 654.058422] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.058422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.058422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.058422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.058422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.058422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a465952-674f-435c-85cf-3d38dcbd3d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.085610] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8225c502-31e3-4647-81d7-822207525369 tempest-ServersWithSpecificFlavorTestJSON-1490539426 tempest-ServersWithSpecificFlavorTestJSON-1490539426-project-member] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 654.086020] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 654.086337] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.086452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.086516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.086754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.086827] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.285551] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7576d294-4db9-4d98-84a5-11c421a2403b tempest-ServersWithSpecificFlavorTestJSON-1490539426 tempest-ServersWithSpecificFlavorTestJSON-1490539426-project-member] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 654.292024] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 654.292024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.292024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.297855] env[69219]: INFO networking_nsxv3.common.synchronization [None req-32dcb14e-9698-4028-b2b0-a3e11a304cf9 None None] Enqueued Resource ID: 9ecf01c7-ddf6-4db8-9e27-d596cad247b6 with Priority: HIGHEST for action port [ 654.299693] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ecf01c7-ddf6-4db8-9e27-d596cad247b6 with Priority: HIGHEST for action port [ 654.299693] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ecf01c7-ddf6-4db8-9e27-d596cad247b6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.299693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ecf01c7-ddf6-4db8-9e27-d596cad247b6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.299693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ecf01c7-ddf6-4db8-9e27-d596cad247b6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.299693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ecf01c7-ddf6-4db8-9e27-d596cad247b6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.299693] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ecf01c7-ddf6-4db8-9e27-d596cad247b6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.342950] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.343385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.343385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.343620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.343718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.346545] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 654.354184] env[69219]: INFO networking_nsxv3.common.synchronization [req-048ce9b9-2d9a-4283-851e-bc77a13ebac1 req-36199fd8-3738-4101-ada8-783762e58bdc tempest-DeleteServersAdminTestJSON-1802826885 tempest-DeleteServersAdminTestJSON-1802826885-project-member] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 654.355806] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 654.356742] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.357123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.357123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.357503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.357717] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.357882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.358086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.358348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.358564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.358599] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.376033] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.376033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.376033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.376033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.376033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.382876] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 654.537093] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.627015] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.627291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.627291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.627468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.627550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.627706] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 already deleted. [ 654.627921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.628021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.628406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.628406] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.805448] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ecf01c7-ddf6-4db8-9e27-d596cad247b6 [ 654.805448] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.805448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.806688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.806688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.806688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.806688] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ecf01c7-ddf6-4db8-9e27-d596cad247b6 already deleted. [ 654.806688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ecf01c7-ddf6-4db8-9e27-d596cad247b6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.860848] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.861173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.861173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.861924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.861924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.863495] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.863740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.863900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.864384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.864384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.864558] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 already deleted. [ 654.865374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.982450] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.982642] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.982766] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.983054] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.983320] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.983475] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.983604] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.983808] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.983944] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.987278] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.987278] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.987278] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.987278] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.987278] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.987278] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.987278] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.005489] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.005643] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.005802] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.005954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.006300] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-01d8f02b-58d0-47e5-b88c-188894f481ab taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.006529] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.006651] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.006973] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.007132] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01d8f02b-58d0-47e5-b88c-188894f481ab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.039973] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.043291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.043291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.043291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.043291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.043291] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be created. [ 655.065843] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.066696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.066888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.067192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.067449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.080361] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: UNINITIALIZED for 2s [ 655.160796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.160796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.160796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.160796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.160796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.161073] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 already deleted. [ 655.161073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.265192] env[69219]: INFO networking_nsxv3.common.synchronization [req-217e265a-0254-45ec-9d1a-c25ebf8369dd req-0fb99363-b456-442f-8af9-af4aa2989bc3 tempest-FloatingIPsAssociationNegativeTestJSON-1139219605 tempest-FloatingIPsAssociationNegativeTestJSON-1139219605-project-member] Enqueued Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_members [ 655.266730] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_members [ 655.267063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.267205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.267287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.267545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.267733] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.270100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.270100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.270100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.270258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.270844] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.289755] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8d938d8e-86cb-4a95-b190-a178f81df455 None None] Enqueued Resource ID: f27ff701-503c-450a-b211-49b574f434c1 with Priority: HIGHEST for action port [ 655.289755] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f27ff701-503c-450a-b211-49b574f434c1 with Priority: HIGHEST for action port [ 655.289755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f27ff701-503c-450a-b211-49b574f434c1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.289890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f27ff701-503c-450a-b211-49b574f434c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.289890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f27ff701-503c-450a-b211-49b574f434c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.292105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f27ff701-503c-450a-b211-49b574f434c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.292105] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f27ff701-503c-450a-b211-49b574f434c1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.511841] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.511841] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.511841] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.514284] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.514569] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.514728] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 01d8f02b-58d0-47e5-b88c-188894f481ab not found, creating... [ 655.515075] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.515258] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.515376] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.515637] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.515807] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.517059] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.517703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.517799] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.518201] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.518362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.518513] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 01d8f02b-58d0-47e5-b88c-188894f481ab is going to be created. [ 655.540566] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.542988] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.542988] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.542988] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.542988] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.542988] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.672390] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.672585] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-48" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.672707] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-48" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.673059] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-48" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.673574] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.673574] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.673574] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.673861] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.673923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.674604] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.674604] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.674729] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.674729] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.674848] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.674953] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.675113] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.700166] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.700166] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.700166] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.700166] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-48" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.700166] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-01bbc7a9-a82b-4f31-8880-fabf606418d9 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.700166] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.700166] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.700166] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.700166] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01bbc7a9-a82b-4f31-8880-fabf606418d9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.775066] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.775246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.776048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.776048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.776048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.776048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.776289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.776289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.776413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.776452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.776544] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce450239-c791-4c8d-86b2-a1dd86547bbc already deleted. [ 655.776634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.792909] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f27ff701-503c-450a-b211-49b574f434c1 [ 655.793175] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.793328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.793541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.793777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.794206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794355] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f27ff701-503c-450a-b211-49b574f434c1 already deleted. [ 655.794455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f27ff701-503c-450a-b211-49b574f434c1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.799181] env[69219]: INFO networking_nsxv3.common.synchronization [None req-fc00fdc4-87af-4401-8394-fc8be52e2af5 None None] Enqueued Resource ID: bf5b364f-727a-426b-acef-24142ec1b309 with Priority: HIGHEST for action port [ 655.799444] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5b364f-727a-426b-acef-24142ec1b309 with Priority: HIGHEST for action port [ 655.800479] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5b364f-727a-426b-acef-24142ec1b309 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.800862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5b364f-727a-426b-acef-24142ec1b309" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.801035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5b364f-727a-426b-acef-24142ec1b309" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.801234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5b364f-727a-426b-acef-24142ec1b309" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.801317] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5b364f-727a-426b-acef-24142ec1b309',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.203016] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.203454] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.203454] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.203684] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.203832] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.203991] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 01bbc7a9-a82b-4f31-8880-fabf606418d9 not found, creating... [ 656.204277] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.204440] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.204557] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.204777] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.204930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.205222] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.205366] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.205484] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.205695] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.205846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.205960] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 01bbc7a9-a82b-4f31-8880-fabf606418d9 is going to be created. [ 656.228350] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.228350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.228350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.228350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.228520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.228802] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.303565] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf5b364f-727a-426b-acef-24142ec1b309 [ 656.303841] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.303935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.303980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.304210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.304298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.304391] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf5b364f-727a-426b-acef-24142ec1b309 already deleted. [ 656.304467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5b364f-727a-426b-acef-24142ec1b309" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.395531] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 656.395674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.395905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.396222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.396449] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.396693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.396693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.399545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.399705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.399846] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.903943] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.011636] env[69219]: INFO networking_nsxv3.common.synchronization [req-048ce9b9-2d9a-4283-851e-bc77a13ebac1 req-39833232-6a62-49eb-b916-65f04cc9ea80 service nova] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_rules [ 657.011636] env[69219]: INFO networking_nsxv3.common.synchronization [req-048ce9b9-2d9a-4283-851e-bc77a13ebac1 req-39833232-6a62-49eb-b916-65f04cc9ea80 service nova] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 657.011636] env[69219]: INFO networking_nsxv3.common.synchronization [req-048ce9b9-2d9a-4283-851e-bc77a13ebac1 req-39833232-6a62-49eb-b916-65f04cc9ea80 service nova] Enqueued Resource ID: 01d8f02b-58d0-47e5-b88c-188894f481ab with Priority: HIGHEST for action port [ 657.011963] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_rules [ 657.012110] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 657.012215] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d8f02b-58d0-47e5-b88c-188894f481ab with Priority: HIGHEST for action port [ 657.012536] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.012625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.012716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.012921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.013018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.014040] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.014040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.014040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.014241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.014565] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.014565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.014565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.014757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.014757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.014832] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.015590] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-01d8f02b-58d0-47e5-b88c-188894f481ab taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.015685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.015685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.016018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.016018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01d8f02b-58d0-47e5-b88c-188894f481ab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.094097] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: SUCCESS [ 657.094387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.094541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.094754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.094943] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.095124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.095173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.096032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.096032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.096032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.096032] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.198960] env[69219]: INFO networking_nsxv3.common.synchronization [req-217e265a-0254-45ec-9d1a-c25ebf8369dd req-c4df1958-dd9a-43c9-bd3b-00992b7965b9 service nova] Enqueued Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_rules [ 657.198960] env[69219]: INFO networking_nsxv3.common.synchronization [req-217e265a-0254-45ec-9d1a-c25ebf8369dd req-c4df1958-dd9a-43c9-bd3b-00992b7965b9 service nova] Enqueued Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_members [ 657.199491] env[69219]: INFO networking_nsxv3.common.synchronization [req-217e265a-0254-45ec-9d1a-c25ebf8369dd req-c4df1958-dd9a-43c9-bd3b-00992b7965b9 service nova] Enqueued Resource ID: 01bbc7a9-a82b-4f31-8880-fabf606418d9 with Priority: HIGHEST for action port [ 657.199757] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_rules [ 657.199909] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_members [ 657.200022] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bbc7a9-a82b-4f31-8880-fabf606418d9 with Priority: HIGHEST for action port [ 657.200936] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.201518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.201518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.201518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.201518] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.202665] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.203141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.203141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.203141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.203685] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.205502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.205502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.205502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.205502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.205502] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.205502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-01bbc7a9-a82b-4f31-8880-fabf606418d9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.205863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.205863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.205995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.205995] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01bbc7a9-a82b-4f31-8880-fabf606418d9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.406185] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.521162] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.521295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.521507] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.523136] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01d8f02b-58d0-47e5-b88c-188894f481ab with status ACTIVE [ 657.523340] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.523483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.523553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.523776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.523891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.524039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.524177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.524211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.525471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.525471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.525471] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.525471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.525471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.525471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.525471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.525471] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01d8f02b-58d0-47e5-b88c-188894f481ab is going to be updated. [ 657.545936] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.546071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.546143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.546351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.546481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.546641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01d8f02b-58d0-47e5-b88c-188894f481ab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.573569] env[69219]: INFO networking_nsxv3.common.synchronization [req-53fdf763-c08f-471f-b8f7-e1d75fc1c205 req-6ea33ed3-e35f-43be-9e90-a9cb583e7dd6 tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 657.573569] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 657.573569] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.573569] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.573569] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.598453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.598453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.598664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.599137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.599137] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.599137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.599137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.599325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.599359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.599719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.599719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.599719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.599719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.599890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.599975] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.600569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.600569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.601454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.601454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.601454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.601454] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.706403] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.708119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.708119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.708119] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01bbc7a9-a82b-4f31-8880-fabf606418d9 with status ACTIVE [ 657.708119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.708351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.708351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.708504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.708596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.708769] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.708895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.708957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.709126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.709201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.709411] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.709516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.709622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.709711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.709824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.709889] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01bbc7a9-a82b-4f31-8880-fabf606418d9 is going to be updated. [ 657.731695] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.731950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.732045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.732293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.732480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.732691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01bbc7a9-a82b-4f31-8880-fabf606418d9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.909572] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.909877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.909877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.910182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.910182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.910530] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 657.939982] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.940197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.940197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.941646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.941646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.952422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 658.023526] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.075754] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.076102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.077637] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.077637] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 already deleted. [ 658.077637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.105062] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f8662e1-7633-4a32-9aae-91c642b75dd8: rpc.has_security_group_logging(os_id): False [ 658.123584] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.123726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.124470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.127912] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.127912] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.127912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.129555] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.129702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.129808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.129946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.130032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.130124] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be created. [ 658.186193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.186416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.186416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.186623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.186797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.197627] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: IN_PROGRESS for 2s [ 658.215713] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.491954] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.492997] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.492997] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.493294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.493692] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.494534] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.494534] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.494618] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.494759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.494985] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.495121] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.495233] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.495345] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.495449] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.496049] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.496295] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.514491] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.514652] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 658.514796] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.515009] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.515488] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.516378] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.516378] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.516640] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.516750] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.528954] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.529089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.529261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.529518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.530217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.530217] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be created. [ 658.558441] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.558549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.558585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.558788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.558985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.569260] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: UNINITIALIZED for 2s [ 658.719734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.719995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.720136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.720457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.720624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.720685] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce450239-c791-4c8d-86b2-a1dd86547bbc is going to be created. [ 658.743483] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.746050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.746050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.746050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.746050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.754087] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce450239-c791-4c8d-86b2-a1dd86547bbc in Status: UNINITIALIZED for 2s [ 659.026358] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.026600] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.026728] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.027086] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.027247] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.027461] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf not found, creating... [ 659.027848] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.028132] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.028294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.028616] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.028779] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.033315] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.033315] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.033315] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.033315] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.033315] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.033315] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf is going to be created. [ 659.056069] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.056069] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.056069] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.056069] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.056069] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.056069] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.943444] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2720161b-62bb-4903-a133-565ac60af19f None None] Enqueued Resource ID: 672380b1-cc32-492f-ab04-40a46532ae16 with Priority: HIGHEST for action port [ 659.943444] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 672380b1-cc32-492f-ab04-40a46532ae16 with Priority: HIGHEST for action port [ 659.944560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-672380b1-cc32-492f-ab04-40a46532ae16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.944560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-672380b1-cc32-492f-ab04-40a46532ae16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.944560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-672380b1-cc32-492f-ab04-40a46532ae16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.944953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-672380b1-cc32-492f-ab04-40a46532ae16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.944953] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('672380b1-cc32-492f-ab04-40a46532ae16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.964917] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 659.964917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.964917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.964917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.964917] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.964917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.964917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.964917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.964917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.964917] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.177776] env[69219]: INFO networking_nsxv3.common.synchronization [req-a38ecca2-3e25-493e-9f1d-accd66b352c0 req-314a6c36-e76e-4072-a032-dd0f7a0ce03e tempest-ServerDiagnosticsTest-1755697257 tempest-ServerDiagnosticsTest-1755697257-project-member] Enqueued Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_members [ 660.178380] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_members [ 660.178769] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.179648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.179648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.179648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.179648] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.179648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.179648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.180031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.180412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.182038] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.219954] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: SUCCESS [ 660.220225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.228033] env[69219]: INFO networking_nsxv3.common.synchronization [req-53fdf763-c08f-471f-b8f7-e1d75fc1c205 req-4b662ad7-132c-4d76-90d7-c31df7caf68f service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 660.228304] env[69219]: INFO networking_nsxv3.common.synchronization [req-53fdf763-c08f-471f-b8f7-e1d75fc1c205 req-4b662ad7-132c-4d76-90d7-c31df7caf68f service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 660.228452] env[69219]: INFO networking_nsxv3.common.synchronization [req-53fdf763-c08f-471f-b8f7-e1d75fc1c205 req-4b662ad7-132c-4d76-90d7-c31df7caf68f service nova] Enqueued Resource ID: ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf with Priority: HIGHEST for action port [ 660.229557] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 660.229832] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 660.229832] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf with Priority: HIGHEST for action port [ 660.230146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.230311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.231567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.231567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.231567] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.231827] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.231827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.231908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.232058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.232240] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.232386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.232446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.232642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.232741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.232845] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.233665] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.233765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.233833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.234092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.234969] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.450230] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 672380b1-cc32-492f-ab04-40a46532ae16 [ 660.450669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.450896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.450997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.451372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.451472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.451574] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:672380b1-cc32-492f-ab04-40a46532ae16 already deleted. [ 660.451656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-672380b1-cc32-492f-ab04-40a46532ae16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.469880] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.578591] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: SUCCESS [ 660.578591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.578591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.578591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.578818] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.578885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.578967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.579134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.579183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.580073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.580073] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.684237] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.684237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.684730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.684730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.684813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.685137] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.685410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.685410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.685410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.685513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.685575] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f349768-69c7-4906-9f16-20b4268d8357 already deleted. [ 660.685655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.736226] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.736356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.736575] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf with status ACTIVE [ 660.737889] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.738094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.738176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.738382] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.738549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.738801] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.738961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.739041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.739204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.739291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.739474] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.739568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.739646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.739759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.739859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.739909] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf is going to be updated. [ 660.742089] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.771332] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.771332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.771332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.771332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.771332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.771332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea654ecc-24e2-4bbd-ba4d-e24ea46b8abf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.772286] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce450239-c791-4c8d-86b2-a1dd86547bbc in Status: SUCCESS [ 660.772459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.772837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.773041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.773220] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.773325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.773383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.773535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.773614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.773695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.776461] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.921140] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.921340] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.921462] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.921744] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.922669] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.922902] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.923063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.923330] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.923505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.923734] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.923868] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.924033] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.924224] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.924362] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.924488] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.924617] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.944160] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.944467] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.944565] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.944750] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.945090] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.945303] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.946906] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.946906] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.946906] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b089f8df-2186-4d0e-97c1-2f7d3d7f340c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.954386] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2182aad9-c82f-4bb8-92ba-daf9ba1bf175 None None] Enqueued Resource ID: cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9 with Priority: HIGHEST for action port [ 660.954637] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9 with Priority: HIGHEST for action port [ 660.955209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.955325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.955388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.955620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.955697] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.972630] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.082132] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.082285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.082354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.082581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.082750] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.082848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.082908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.083067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.083151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.083238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.083380] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.083466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.083523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.083657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.083878] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.083878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.083977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.084086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.084167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.084244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.084330] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.248830] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.278915] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.279220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.279338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.279722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.280103] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.280216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.280354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.280676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.282423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.282557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.282744] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.282846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.282908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.283467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.283628] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.283727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.283787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.283940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.284029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.284111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.284199] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.461670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9 [ 661.461670] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.461857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.461929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.463420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.463542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.464477] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9 already deleted. [ 661.464477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdf9e9c8-1815-433c-b4b5-dcf2b8ef8fc9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.464477] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.464477] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.464759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.464759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.464900] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.465079] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b089f8df-2186-4d0e-97c1-2f7d3d7f340c not found, creating... [ 661.465334] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.465496] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.465615] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.465846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.465971] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.466841] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.467056] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.467169] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.467612] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.467761] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.467907] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b089f8df-2186-4d0e-97c1-2f7d3d7f340c is going to be created. [ 661.474973] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.475147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.475239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.475453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.475498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.475583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 661.493121] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.493121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.493121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.493121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.493121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.493121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.503595] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.503595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.503595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.503595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.503595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.513415] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 661.587681] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9153ebdf-4f47-4818-bdd9-2172ee701c16: rpc.has_security_group_logging(os_id): False [ 661.611719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.611719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.611719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.612306] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.612306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.612306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.612306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.612306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.612489] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.612605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.612668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.612832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.614043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.614043] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be created. [ 661.677579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.678230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.678230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.678230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.678409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.690320] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: IN_PROGRESS for 2s [ 661.751867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.752122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.752743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.752743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.752743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.752743] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be created. [ 661.785032] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.785032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.785032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.785032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.785032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.787256] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce450239-c791-4c8d-86b2-a1dd86547bbc: rpc.has_security_group_logging(os_id): False [ 661.803037] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: UNINITIALIZED for 2s [ 661.809530] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.809788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.809922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.810226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.810386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.810637] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.810785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.810924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.811162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.812418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.812949] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.813147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.813668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.813668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.813668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.813835] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.814063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.814063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.814450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.814450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.814450] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce450239-c791-4c8d-86b2-a1dd86547bbc is going to be created. [ 661.876726] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.877052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.877245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.877528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.877735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.891397] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce450239-c791-4c8d-86b2-a1dd86547bbc in Status: IN_PROGRESS for 2s [ 662.155296] env[69219]: INFO networking_nsxv3.common.synchronization [None req-928bd02c-1b38-4a2d-88a5-d29455c41aaf None None] Enqueued Resource ID: 5516df84-df37-4a9d-b0a3-7cb1477989db with Priority: HIGHEST for action port [ 662.155296] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5516df84-df37-4a9d-b0a3-7cb1477989db with Priority: HIGHEST for action port [ 662.155296] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-5516df84-df37-4a9d-b0a3-7cb1477989db taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.155296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5516df84-df37-4a9d-b0a3-7cb1477989db" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.155296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5516df84-df37-4a9d-b0a3-7cb1477989db" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.155296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5516df84-df37-4a9d-b0a3-7cb1477989db" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.155296] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5516df84-df37-4a9d-b0a3-7cb1477989db',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.660675] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5516df84-df37-4a9d-b0a3-7cb1477989db [ 662.661911] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.662203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.662305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.662556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.662701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.662848] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5516df84-df37-4a9d-b0a3-7cb1477989db already deleted. [ 662.662927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5516df84-df37-4a9d-b0a3-7cb1477989db" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.939432] env[69219]: INFO networking_nsxv3.common.synchronization [req-a38ecca2-3e25-493e-9f1d-accd66b352c0 req-36aec9ec-7649-4528-b2aa-da1f0e2966b6 service nova] Enqueued Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_rules [ 662.939737] env[69219]: INFO networking_nsxv3.common.synchronization [req-a38ecca2-3e25-493e-9f1d-accd66b352c0 req-36aec9ec-7649-4528-b2aa-da1f0e2966b6 service nova] Enqueued Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_members [ 662.939982] env[69219]: INFO networking_nsxv3.common.synchronization [req-a38ecca2-3e25-493e-9f1d-accd66b352c0 req-36aec9ec-7649-4528-b2aa-da1f0e2966b6 service nova] Enqueued Resource ID: b089f8df-2186-4d0e-97c1-2f7d3d7f340c with Priority: HIGHEST for action port [ 662.942055] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_rules [ 662.942281] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_members [ 662.942372] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b089f8df-2186-4d0e-97c1-2f7d3d7f340c with Priority: HIGHEST for action port [ 662.943259] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.943471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.943584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.943953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.944706] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.945874] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.946036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.946110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.946338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.946847] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.947028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.947099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.947269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.947357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.947453] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.952024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.952024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.952024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.952024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.952024] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b089f8df-2186-4d0e-97c1-2f7d3d7f340c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.433270] env[69219]: INFO networking_nsxv3.common.synchronization [None req-6350fae9-84a5-4489-b2d2-2969e71c27ed None None] Enqueued Resource ID: cc60cf84-6862-4e20-ac9b-6d349c53c189 with Priority: HIGHEST for action port [ 663.434144] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc60cf84-6862-4e20-ac9b-6d349c53c189 with Priority: HIGHEST for action port [ 663.434438] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc60cf84-6862-4e20-ac9b-6d349c53c189 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.434596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc60cf84-6862-4e20-ac9b-6d349c53c189" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.434690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc60cf84-6862-4e20-ac9b-6d349c53c189" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.435416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc60cf84-6862-4e20-ac9b-6d349c53c189" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.435514] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc60cf84-6862-4e20-ac9b-6d349c53c189',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.450462] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.452697] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.452697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.452697] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b089f8df-2186-4d0e-97c1-2f7d3d7f340c with status ACTIVE [ 663.452925] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.452925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.452925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.456637] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.456637] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.456637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.456637] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b089f8df-2186-4d0e-97c1-2f7d3d7f340c is going to be updated. [ 663.474467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.474467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.476998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.478869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.478869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.478869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b089f8df-2186-4d0e-97c1-2f7d3d7f340c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.526939] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 4s [ 663.576213] env[69219]: INFO networking_nsxv3.common.synchronization [req-a4bfc556-fdb0-4104-a0c5-63ec6f686dea req-e1a76f63-d51a-4bf9-b307-c0e2153c6f72 tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 663.576213] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 663.576213] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.576213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.677035] env[69219]: INFO networking_nsxv3.common.synchronization [None req-9be854b4-5368-4863-8f0d-f4e81290ac43 None None] Enqueued Resource ID: 7c4ee5c8-21eb-4863-8fc2-be5e2427da4d with Priority: HIGHEST for action port [ 663.677035] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c4ee5c8-21eb-4863-8fc2-be5e2427da4d with Priority: HIGHEST for action port [ 663.677035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c4ee5c8-21eb-4863-8fc2-be5e2427da4d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.677035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c4ee5c8-21eb-4863-8fc2-be5e2427da4d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.677035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c4ee5c8-21eb-4863-8fc2-be5e2427da4d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.679113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c4ee5c8-21eb-4863-8fc2-be5e2427da4d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.679113] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c4ee5c8-21eb-4863-8fc2-be5e2427da4d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.703146] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: SUCCESS [ 663.703146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.812150] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 663.812299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.812864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.813122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.813347] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.813463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.813526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.813686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.813762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.813861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.813951] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.816230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.816408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.816584] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.816768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.816854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.817042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.817161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.817286] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.900953] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce450239-c791-4c8d-86b2-a1dd86547bbc in Status: SUCCESS [ 663.901201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.939501] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc60cf84-6862-4e20-ac9b-6d349c53c189 [ 663.939501] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.939501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.939501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.939920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.940391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.940583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc60cf84-6862-4e20-ac9b-6d349c53c189 already deleted. [ 663.940625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc60cf84-6862-4e20-ac9b-6d349c53c189" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.953015] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.182770] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c4ee5c8-21eb-4863-8fc2-be5e2427da4d [ 664.182770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.182770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.182770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.182770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.182770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.182770] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c4ee5c8-21eb-4863-8fc2-be5e2427da4d already deleted. [ 664.182770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c4ee5c8-21eb-4863-8fc2-be5e2427da4d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.318071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.318283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.322154] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.456867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.460201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.460201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.460201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.460201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.460201] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f349768-69c7-4906-9f16-20b4268d8357 is going to be created. [ 664.481484] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.482286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.482286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.482286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.484842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.495140] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f349768-69c7-4906-9f16-20b4268d8357 in Status: UNINITIALIZED for 2s [ 664.810824] env[69219]: INFO networking_nsxv3.common.synchronization [None req-86c24d00-61cb-430a-8d16-e0ac2491952b None None] Enqueued Resource ID: 6cad914b-1926-420f-aacb-6fe2242eb85b with Priority: HIGHEST for action port [ 664.811121] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cad914b-1926-420f-aacb-6fe2242eb85b with Priority: HIGHEST for action port [ 664.811711] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cad914b-1926-420f-aacb-6fe2242eb85b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.811836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cad914b-1926-420f-aacb-6fe2242eb85b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.814238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cad914b-1926-420f-aacb-6fe2242eb85b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.814238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cad914b-1926-420f-aacb-6fe2242eb85b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.814238] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cad914b-1926-420f-aacb-6fe2242eb85b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.824866] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.900720] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.901033] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.901135] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.901374] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.901644] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.902143] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.902143] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.904776] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.904776] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.904776] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.904776] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.904776] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.904776] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.904776] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 664.904776] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.904776] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.924629] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.924775] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 664.924848] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.924990] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.925344] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-63394047-b766-4c03-aea9-3160e82a0922 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.925535] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.925660] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.926818] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.926818] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63394047-b766-4c03-aea9-3160e82a0922',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.984635] env[69219]: INFO networking_nsxv3.common.synchronization [req-e3a2f579-f485-4d2e-9218-00863885b18a req-bb0b6161-e1a6-4b6e-935a-5be81142d332 tempest-ServersTestJSON-212915453 tempest-ServersTestJSON-212915453-project-member] Enqueued Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_members [ 664.985144] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_members [ 664.985463] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.985583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.985647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.985895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.987324] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.987443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.987510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.987692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.987781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.987879] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.315982] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cad914b-1926-420f-aacb-6fe2242eb85b [ 665.316257] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.316396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.316460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.316674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.316766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.316863] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cad914b-1926-420f-aacb-6fe2242eb85b already deleted. [ 665.317028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cad914b-1926-420f-aacb-6fe2242eb85b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.326575] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.326732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.326819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.327056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.327157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.327251] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 665.350178] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.350178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-725" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.350178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-725" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.350178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-725" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.350178] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.350178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.350694] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.351117] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.354030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.354030] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.354030] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.354030] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.354030] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.354030] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.354030] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.354030] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.358331] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.358331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.358331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.358331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.358331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.369772] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 665.371860] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.372177] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.372256] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.372464] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-725" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.372824] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-73e9eebc-cf93-4634-8c30-0021e2cc8903 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.373042] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.373170] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.373541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.373724] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73e9eebc-cf93-4634-8c30-0021e2cc8903',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.430789] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.432759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.432759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.432759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.432759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.432759] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 63394047-b766-4c03-aea9-3160e82a0922 not found, creating... [ 665.432759] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.432759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.432759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.435892] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.435892] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.435892] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.435892] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.435892] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.435892] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.438845] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.438845] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 63394047-b766-4c03-aea9-3160e82a0922 is going to be created. [ 665.458128] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.458446] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.458530] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.458846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.459139] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.459415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.492403] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.492590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.492637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.494085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.494085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.494085] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.494085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.494085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.494085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.494085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.494085] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 already deleted. [ 665.494085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.537916] env[69219]: INFO networking_nsxv3.common.synchronization [None req-26f8c744-c761-4748-86fb-3e7fadf68c91 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_rules [ 665.539684] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_rules [ 665.540910] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 665.541156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.541456] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.541578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.541639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.541915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.542039] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.544085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.544085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.544299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.544403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.544582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.544638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.545570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.545570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.545570] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.545570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.545570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.545570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.545570] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.545570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.545570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.546048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.546048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.546048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.546048] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.659794] env[69219]: INFO networking_nsxv3.common.synchronization [None req-1c893864-1f30-4c0f-bf20-57c8cb6413cb tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_rules [ 665.664598] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_rules [ 665.665164] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.665305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.876634] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.876974] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.878053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.878405] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.881253] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.881499] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 73e9eebc-cf93-4634-8c30-0021e2cc8903 not found, creating... [ 665.881751] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.882520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.882520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.882520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.882827] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.882965] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.883148] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.883299] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.883577] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.883746] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.883891] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 73e9eebc-cf93-4634-8c30-0021e2cc8903 is going to be created. [ 665.903823] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.903823] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.903823] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.906027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.906027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.906027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.967195] env[69219]: INFO networking_nsxv3.common.synchronization [None req-1b534faa-15bb-4734-a5a8-679c3c54946f None None] Enqueued Resource ID: aa458f62-5c32-499e-b8bb-84e6289de5e6 with Priority: HIGHEST for action port [ 665.967678] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa458f62-5c32-499e-b8bb-84e6289de5e6 with Priority: HIGHEST for action port [ 665.968018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa458f62-5c32-499e-b8bb-84e6289de5e6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.968137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa458f62-5c32-499e-b8bb-84e6289de5e6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.968244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa458f62-5c32-499e-b8bb-84e6289de5e6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.968462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa458f62-5c32-499e-b8bb-84e6289de5e6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.968736] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa458f62-5c32-499e-b8bb-84e6289de5e6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.048483] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b80fc8-a901-412d-adfd-ccd8a04c683d: rpc.has_security_group_logging(os_id): False [ 666.068088] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.068245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.068314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.068527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.069140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.069140] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c already deleted. [ 666.069140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.069656] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.070196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.070196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.070196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.070379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.070831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.070831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.070831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.071273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.071273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.071273] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.071273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.071420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.071457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.071689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.071689] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.071798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.072092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.072092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.072092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.072204] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be created. [ 666.073471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.073682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.073759] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.135235] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.135380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.135448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.135665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.135842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.148794] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 666.187794] env[69219]: INFO networking_nsxv3.common.synchronization [None req-06b508d0-4229-43ad-a175-e78d5592f01a None None] Enqueued Resource ID: a93fdeba-333c-4e89-84af-fce45692713d with Priority: HIGHEST for action port [ 666.188117] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a93fdeba-333c-4e89-84af-fce45692713d with Priority: HIGHEST for action port [ 666.188761] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-a93fdeba-333c-4e89-84af-fce45692713d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.188822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a93fdeba-333c-4e89-84af-fce45692713d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.188893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a93fdeba-333c-4e89-84af-fce45692713d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.189125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a93fdeba-333c-4e89-84af-fce45692713d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.189401] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a93fdeba-333c-4e89-84af-fce45692713d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.477019] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa458f62-5c32-499e-b8bb-84e6289de5e6 [ 666.477019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.477314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.477314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.477373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.477914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.477914] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa458f62-5c32-499e-b8bb-84e6289de5e6 already deleted. [ 666.477914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa458f62-5c32-499e-b8bb-84e6289de5e6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.504884] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f349768-69c7-4906-9f16-20b4268d8357 in Status: UNINITIALIZED for 4s [ 666.596057] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.596258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.596367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.596611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.596773] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.596967] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c already deleted. [ 666.597038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.646486] env[69219]: INFO networking_nsxv3.common.synchronization [None req-86858fa2-5cf2-453a-b678-e3ebcbd58eb5 tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 666.647115] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 666.648366] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.648567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.649399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.649399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.649399] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.683825] env[69219]: INFO networking_nsxv3.common.synchronization [req-a4bfc556-fdb0-4104-a0c5-63ec6f686dea req-64b6c733-600e-4809-b828-1debc8ed759c service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 666.684034] env[69219]: INFO networking_nsxv3.common.synchronization [req-a4bfc556-fdb0-4104-a0c5-63ec6f686dea req-64b6c733-600e-4809-b828-1debc8ed759c service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 666.684234] env[69219]: INFO networking_nsxv3.common.synchronization [req-a4bfc556-fdb0-4104-a0c5-63ec6f686dea req-64b6c733-600e-4809-b828-1debc8ed759c service nova] Enqueued Resource ID: 63394047-b766-4c03-aea9-3160e82a0922 with Priority: HIGHEST for action port [ 666.684675] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 666.684855] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 666.684964] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63394047-b766-4c03-aea9-3160e82a0922 with Priority: HIGHEST for action port [ 666.685847] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.686068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.686280] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.686387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.686664] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-63394047-b766-4c03-aea9-3160e82a0922 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.686767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.686801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.687033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.687124] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63394047-b766-4c03-aea9-3160e82a0922',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.692232] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a93fdeba-333c-4e89-84af-fce45692713d [ 666.692410] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.692522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.692590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.692808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.692858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.693073] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a93fdeba-333c-4e89-84af-fce45692713d already deleted. [ 666.694056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a93fdeba-333c-4e89-84af-fce45692713d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.889139] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5496d21a-30ea-40b6-a308-2e0a2da22ded tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 666.890734] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 666.891883] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.892823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.036017] env[69219]: INFO networking_nsxv3.common.synchronization [req-e3a2f579-f485-4d2e-9218-00863885b18a req-864dcea7-28de-4c69-8d87-9506e6bc2d30 service nova] Enqueued Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_rules [ 667.036017] env[69219]: INFO networking_nsxv3.common.synchronization [req-e3a2f579-f485-4d2e-9218-00863885b18a req-864dcea7-28de-4c69-8d87-9506e6bc2d30 service nova] Enqueued Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_members [ 667.036017] env[69219]: INFO networking_nsxv3.common.synchronization [req-e3a2f579-f485-4d2e-9218-00863885b18a req-864dcea7-28de-4c69-8d87-9506e6bc2d30 service nova] Enqueued Resource ID: 73e9eebc-cf93-4634-8c30-0021e2cc8903 with Priority: HIGHEST for action port [ 667.036017] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_rules [ 667.036017] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_members [ 667.036017] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e9eebc-cf93-4634-8c30-0021e2cc8903 with Priority: HIGHEST for action port [ 667.036595] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.036716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.036780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.036970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.037259] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.038602] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.038674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.038720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.038953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.039122] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.039213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.039213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.039348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.039461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.039553] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.040338] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-73e9eebc-cf93-4634-8c30-0021e2cc8903 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.040481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.040767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.040767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.040767] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73e9eebc-cf93-4634-8c30-0021e2cc8903',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.170507] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.170690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.170754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.170928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.171031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.171129] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe already deleted. [ 667.171219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.171386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.171543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.171623] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.190334] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63394047-b766-4c03-aea9-3160e82a0922 with status ACTIVE [ 667.190594] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.190731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.190802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.191014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.191111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.191285] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.191497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.191497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.191583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.191657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.191891] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.191954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.192065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.192186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.192261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.192345] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63394047-b766-4c03-aea9-3160e82a0922 is going to be updated. [ 667.212146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.212532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.212804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.213283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.213499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.213691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63394047-b766-4c03-aea9-3160e82a0922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.379137] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 667.379261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.380342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.380342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.380342] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.380342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.380342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.380342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.380342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.380768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.381140] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.381455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.381455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.382381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.382675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.382842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.382961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.383172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.383309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.383440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.383632] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.384654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.384852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.385101] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.385330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.385458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.385649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.385798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.385963] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.397251] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f40bff9-a864-4b43-b934-258424ee02e3 req-27b98db2-c267-4c49-bbd7-8f38d851a3d1 tempest-VolumesAssistedSnapshotsTest-1735245712 tempest-VolumesAssistedSnapshotsTest-1735245712-project-member] Enqueued Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_members [ 667.397251] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_members [ 667.397481] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.397607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.397673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.397952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.398530] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.398729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.398861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.399143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.399292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.399443] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.546733] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.551763] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.551763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.551763] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73e9eebc-cf93-4634-8c30-0021e2cc8903 with status ACTIVE [ 667.551763] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.551763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.551763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.551763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.551763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.551763] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.552630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.552630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.552630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.552630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.552765] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.552835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.552928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.553132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.553216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.553308] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73e9eebc-cf93-4634-8c30-0021e2cc8903 is going to be updated. [ 667.575725] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.575979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.576031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.576274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.576452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.576638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73e9eebc-cf93-4634-8c30-0021e2cc8903" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.693816] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.693816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.693816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.693816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.694348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.695188] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe already deleted. [ 667.695188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.888239] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b911077-41e4-4e60-b59f-e672bb56c601: rpc.has_security_group_logging(os_id): False [ 667.893317] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.902831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.902831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.902831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.902831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.903205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.903205] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.903205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.903332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.903416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.903468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.903548] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6f62def-0bf8-403b-b778-966080958ecc already deleted. [ 667.904315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.917163] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.917163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.917163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.917163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.917163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.917163] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.917163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.917543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.917543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.917543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.917959] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.917959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.917959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.918287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.918287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.918722] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.918722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.918722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.918722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.918899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.918899] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be created. [ 667.978397] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.978685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.978685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.978837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.979048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.993266] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 668.055973] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.080432] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.080652] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-946" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.080652] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-946" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.080917] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-946" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.081198] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.081358] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.081480] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.081705] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.081883] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.083217] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.083217] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.083217] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.083217] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.083217] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 668.083217] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.083217] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.108679] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.108859] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 668.109016] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.109221] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-946" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.110085] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.110281] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.110404] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.110726] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.110865] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ec631f3-0961-4eda-9d81-e1095ba3b9ad',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.165781] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 668.166078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.166312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.166560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.166668] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.395389] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.515260] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f349768-69c7-4906-9f16-20b4268d8357 in Status: SUCCESS [ 668.516071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.518028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.518028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.518028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.518028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.518028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.518028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.518028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.518028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.518028] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.558148] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.558875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.559322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.560123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.561890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.561890] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 is going to be created. [ 668.585810] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.585810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.585810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.585810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.585810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.593808] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 in Status: UNINITIALIZED for 2s [ 668.619202] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.619202] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.619202] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.619202] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.619202] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.619202] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 4ec631f3-0961-4eda-9d81-e1095ba3b9ad not found, creating... [ 668.619654] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.619654] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.619768] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.619981] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.620254] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.620596] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.620596] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.623606] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.626138] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.626138] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.626138] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 4ec631f3-0961-4eda-9d81-e1095ba3b9ad is going to be created. [ 668.647457] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.647457] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.647457] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.647457] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.647457] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.647457] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.670063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.670350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.670454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.670724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.670933] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.671073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.671144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.672810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.672810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.672810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.672810] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.897889] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.898071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.898170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.898485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.898579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.898701] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 668.917804] env[69219]: INFO networking_nsxv3.common.synchronization [None req-b8cfc6e2-55f2-43cc-b63d-1648360fcb89 None None] Enqueued Resource ID: 26fede8d-abad-4067-90e1-fa9c8ccd6a92 with Priority: HIGHEST for action port [ 668.918188] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26fede8d-abad-4067-90e1-fa9c8ccd6a92 with Priority: HIGHEST for action port [ 668.918822] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-26fede8d-abad-4067-90e1-fa9c8ccd6a92 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.918957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26fede8d-abad-4067-90e1-fa9c8ccd6a92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.919608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26fede8d-abad-4067-90e1-fa9c8ccd6a92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.919920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26fede8d-abad-4067-90e1-fa9c8ccd6a92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.919966] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26fede8d-abad-4067-90e1-fa9c8ccd6a92',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.927097] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.927442] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.927557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.927755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.927903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.936950] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 669.021164] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.021483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.021646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.021933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.022233] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.022415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.022524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.022723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.022817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.022910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.023098] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.023200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.023261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.023411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.023562] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.023656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.023717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.023855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.023932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.024023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.024112] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.174721] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.174921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.174921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.175184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.175360] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.175467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.175532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.175683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.175785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.175861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.176071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.176167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.176227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.176376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.176516] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.176609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.176665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.176805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.176886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.176972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.177081] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.421996] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26fede8d-abad-4067-90e1-fa9c8ccd6a92 [ 669.425151] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.425151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.425151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.425151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.425151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.425151] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26fede8d-abad-4067-90e1-fa9c8ccd6a92 already deleted. [ 669.425151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26fede8d-abad-4067-90e1-fa9c8ccd6a92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.526568] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f40bff9-a864-4b43-b934-258424ee02e3 req-458e5a7d-0366-47f0-876d-c477f6a467f9 service nova] Enqueued Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_rules [ 669.526568] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f40bff9-a864-4b43-b934-258424ee02e3 req-458e5a7d-0366-47f0-876d-c477f6a467f9 service nova] Enqueued Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_members [ 669.526568] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f40bff9-a864-4b43-b934-258424ee02e3 req-458e5a7d-0366-47f0-876d-c477f6a467f9 service nova] Enqueued Resource ID: 4ec631f3-0961-4eda-9d81-e1095ba3b9ad with Priority: HIGHEST for action port [ 669.526568] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f349768-69c7-4906-9f16-20b4268d8357: rpc.has_security_group_logging(os_id): False [ 669.529022] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_rules [ 669.529163] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_members [ 669.529966] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec631f3-0961-4eda-9d81-e1095ba3b9ad with Priority: HIGHEST for action port [ 669.529966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.530203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.530308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.531295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.531295] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.531926] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.531926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.531926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.536030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.536030] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.536030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.536030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.536030] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ec631f3-0961-4eda-9d81-e1095ba3b9ad',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.553853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.554101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.554215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.554562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.554664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.554907] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.555053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.555177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.555364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.555467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.555650] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.555776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.556345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.556345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.556345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.556552] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.556685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.557026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.557026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.557026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.557189] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f349768-69c7-4906-9f16-20b4268d8357 is going to be created. [ 669.629660] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.629931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.629931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.630099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.630270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.641717] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f349768-69c7-4906-9f16-20b4268d8357 in Status: IN_PROGRESS for 2s [ 669.680160] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b80fc8-a901-412d-adfd-ccd8a04c683d: rpc.has_security_group_logging(os_id): False [ 669.700047] env[69219]: INFO networking_nsxv3.common.synchronization [req-64ad339f-4f36-4999-b419-c96db349cf32 req-0a0a7a88-38c3-4267-8864-3b69e7e5895f tempest-ListServersNegativeTestJSON-476691794 tempest-ListServersNegativeTestJSON-476691794-project-member] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 669.700047] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 669.700047] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.700047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.700047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.700047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.700047] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.700679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.700679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.700679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.700679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.700679] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.711996] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.711996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.711996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.712487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.712487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.713090] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.713090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.713090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.713248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.713248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.714601] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.714601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.714601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.714822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.714822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.715570] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.715570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.715570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.715570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.716193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.716193] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 669.788973] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.789068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.789068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.789290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.789492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.804325] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 670.008970] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 670.009242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.009423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.009637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.009727] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.036147] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.036285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.038637] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ec631f3-0961-4eda-9d81-e1095ba3b9ad with status ACTIVE [ 670.038828] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.038981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.039200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.039303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.039864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.039864] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.039864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.039864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.040163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.040163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.043622] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.043622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.043622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.043622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.043622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.043622] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ec631f3-0961-4eda-9d81-e1095ba3b9ad is going to be updated. [ 670.043622] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.063196] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.063327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.063457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.063609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.063723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.063915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ec631f3-0961-4eda-9d81-e1095ba3b9ad" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.203283] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.513547] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.513689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.549403] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.607585] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 in Status: SUCCESS [ 670.607585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.607721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.607851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.608069] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.608254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.608254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.608427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.608503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.608621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.608669] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.705435] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.946932] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.948490] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.948490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.948490] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.054687] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.054687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.054687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.054687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.054687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.054687] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6f62def-0bf8-403b-b778-966080958ecc is going to be created. [ 671.083048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.083048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.083048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.083048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.083048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.090823] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6f62def-0bf8-403b-b778-966080958ecc in Status: UNINITIALIZED for 2s [ 671.112500] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.210053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.210053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.210053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.210308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.210413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.210526] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 671.239752] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.239855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.239933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.240184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.240349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.248749] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 671.417030] env[69219]: INFO networking_nsxv3.common.synchronization [None req-04d6d07f-ead5-480d-b7c3-ce16a4b66b43 None None] Enqueued Resource ID: 03ad3758-c0e4-451a-a897-4e62e1266530 with Priority: HIGHEST for action port [ 671.417907] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03ad3758-c0e4-451a-a897-4e62e1266530 with Priority: HIGHEST for action port [ 671.418026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-03ad3758-c0e4-451a-a897-4e62e1266530 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.418366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03ad3758-c0e4-451a-a897-4e62e1266530" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.418440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03ad3758-c0e4-451a-a897-4e62e1266530" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.418749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03ad3758-c0e4-451a-a897-4e62e1266530" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.418895] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ad3758-c0e4-451a-a897-4e62e1266530',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.452678] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.453409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.453409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.453409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.453409] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.453785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.453785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.453785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.453970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.453970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.454128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.454211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.454269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.454783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.454783] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.454783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.454783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.455127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.455127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.455127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.455309] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.488412] env[69219]: INFO networking_nsxv3.common.synchronization [None req-ece2a37f-139b-4ea4-b419-ecc1ed14f33c tempest-VolumesAdminNegativeTest-292929570 tempest-VolumesAdminNegativeTest-292929570-project-member] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_rules [ 671.488412] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_rules [ 671.489335] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.489512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.489512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.489811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.489924] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.591134] env[69219]: INFO networking_nsxv3.common.synchronization [None req-48efd4a0-eb97-46c8-8000-359246046b1c tempest-VolumesAdminNegativeTest-292929570 tempest-VolumesAdminNegativeTest-292929570-project-member] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_rules [ 671.591257] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_rules [ 671.591767] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.591767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.615728] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b36cc984-3daf-4544-bdb5-0d70fbf12ba9: rpc.has_security_group_logging(os_id): False [ 671.637366] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.637835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.638036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.638499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.638936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.638936] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.639162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.639762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.639762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.639762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.639762] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 is going to be created. [ 671.657656] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f349768-69c7-4906-9f16-20b4268d8357 in Status: SUCCESS [ 671.658085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.713727] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.713727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.713727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.713727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.714341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.724340] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 in Status: IN_PROGRESS for 2s [ 671.830143] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 671.830143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.830143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.830361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.830417] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.921069] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03ad3758-c0e4-451a-a897-4e62e1266530 [ 671.921365] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.921459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.921545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.921775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.921872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.921972] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03ad3758-c0e4-451a-a897-4e62e1266530 already deleted. [ 671.922069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03ad3758-c0e4-451a-a897-4e62e1266530" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.958726] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b911077-41e4-4e60-b59f-e672bb56c601: rpc.has_security_group_logging(os_id): False [ 671.976739] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.976832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.976999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.977273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.977415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.977643] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.977800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.977870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.978143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.978256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.978506] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.978617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.978681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.978882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.978975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.979349] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.979461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.979525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.979676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.979789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.979919] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 672.010239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.010481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.010530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.010754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.010870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.010980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 already deleted. [ 672.011114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.011347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.011544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.011642] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.037823] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.037929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.038022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.038508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.038508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.051099] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 672.115546] env[69219]: INFO networking_nsxv3.common.synchronization [req-c4bec336-a021-450f-81e1-88d3affdd4dd req-73c13277-e8ca-4f4f-9c46-2e14806e4337 tempest-DeleteServersAdminTestJSON-298818886 tempest-DeleteServersAdminTestJSON-298818886-project-admin] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 672.116178] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 672.116526] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.117167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.117270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.117507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.117723] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.117850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.117935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.118165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.118273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.118393] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.333347] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.333675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.531370] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.531516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.531606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.532034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.532034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.532034] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 already deleted. [ 672.532572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.621910] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.622203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.622327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.622674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.623748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.623748] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.623748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.623748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.624082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.624082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.624082] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be updated. [ 672.652788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.653827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.653827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.653827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.654290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.662154] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: IN_PROGRESS for 2s [ 673.100805] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6f62def-0bf8-403b-b778-966080958ecc in Status: SUCCESS [ 673.101100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.101217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.101425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.101613] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.101731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.101788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.101943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.102037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.102127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.102221] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.259019] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 673.259305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.260550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.260628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.260869] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.261062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.261154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.261373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.261476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.261566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.261672] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.604567] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.736701] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 in Status: SUCCESS [ 673.736940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.764160] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.764542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.764684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.764920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.765112] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.765226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.765285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.765481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.765560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.765622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.765746] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.765838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.765892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.766145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.766307] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.766421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.766499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.766632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.766780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.766831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.766877] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.062424] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 674.062661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109910] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6f62def-0bf8-403b-b778-966080958ecc: rpc.has_security_group_logging(os_id): False [ 674.128426] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.128426] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.128426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.128426] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6f62def-0bf8-403b-b778-966080958ecc is going to be created. [ 674.182224] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.182353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.182428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.182674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.182856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.194373] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6f62def-0bf8-403b-b778-966080958ecc in Status: IN_PROGRESS for 2s [ 674.268935] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b80fc8-a901-412d-adfd-ccd8a04c683d: rpc.has_security_group_logging(os_id): False [ 674.287841] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.287998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.288292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.289297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.289402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.289643] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.289751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.289807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.289975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.290059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.290245] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.290354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.290396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.290580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.290657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.290848] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.290941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.291010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.291842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.292252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.292417] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 674.358960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.359117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.359279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.359874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.359874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.371510] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 674.676407] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: SUCCESS [ 674.679244] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 deletion is rescheduled due to dependency. [ 674.679436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.195766] env[69219]: INFO networking_nsxv3.common.synchronization [req-98c80ee6-4e58-4f91-8684-d86279e7ef39 req-6a7c2df5-6d55-47c3-afa2-bdf729221a44 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 675.199297] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 675.199297] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.199297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.199297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.199297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.199297] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.199297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.199623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.199892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.201087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.201087] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.705980] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.705980] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.705980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.705980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 675.744990] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.744990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.744990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.744990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.744990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.753672] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 676.206777] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6f62def-0bf8-403b-b778-966080958ecc in Status: SUCCESS [ 676.208249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.387839] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 676.387839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.931804] env[69219]: INFO networking_nsxv3.common.synchronization [None req-e9b853bc-2abc-40db-b4dc-bb9472754ef8 None None] Enqueued Resource ID: ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c with Priority: HIGHEST for action port [ 676.931915] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c with Priority: HIGHEST for action port [ 676.932239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.932408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.932444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.933398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.933398] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.436926] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c [ 677.437270] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.437425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.437522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.437753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.438864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.438864] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c already deleted. [ 677.438864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae9c5eb6-a39d-456b-be8a-3fb3e238ed5c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.764311] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 677.764499] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 677.764658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.043947] env[69219]: INFO networking_nsxv3.common.synchronization [req-4de25ab1-01d5-45e7-93df-87dd2fa611fa req-921c4aae-142b-4d6f-bfeb-1d220cfb958b tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 678.043947] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 678.043947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.043947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.043947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.043947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.043947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.043947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.043947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.043947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.044626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.044835] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.503653] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.504095] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.504095] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.505391] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.505698] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.505879] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.506075] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.506259] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.506412] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.506621] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.506760] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.506925] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.507065] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.507176] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 678.507282] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.507414] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.527687] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.527914] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 678.528914] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.528914] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.528914] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-52957432-6bd2-4398-9f34-9ffc9e00b685 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.529314] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.529314] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.529509] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.529618] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52957432-6bd2-4398-9f34-9ffc9e00b685',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.547450] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.547652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.547729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.547987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.548141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.549382] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.549588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.550150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.550548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.550684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.550819] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d already deleted. [ 678.550944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.036980] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.036980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.036980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.036980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.036980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.036980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 52957432-6bd2-4398-9f34-9ffc9e00b685 not found, creating... [ 679.036980] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.036980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.037743] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.038466] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.039047] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.039656] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.040114] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.040508] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.040971] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.041346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.041825] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 52957432-6bd2-4398-9f34-9ffc9e00b685 is going to be created. [ 679.065020] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.065020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.065020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.065020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.065020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.065020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.914859] env[69219]: INFO networking_nsxv3.common.synchronization [req-4de25ab1-01d5-45e7-93df-87dd2fa611fa req-9dfba305-89e1-4da9-bbf9-72a84c4fdf3d service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 679.915116] env[69219]: INFO networking_nsxv3.common.synchronization [req-4de25ab1-01d5-45e7-93df-87dd2fa611fa req-9dfba305-89e1-4da9-bbf9-72a84c4fdf3d service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 679.915206] env[69219]: INFO networking_nsxv3.common.synchronization [req-4de25ab1-01d5-45e7-93df-87dd2fa611fa req-9dfba305-89e1-4da9-bbf9-72a84c4fdf3d service nova] Enqueued Resource ID: 52957432-6bd2-4398-9f34-9ffc9e00b685 with Priority: HIGHEST for action port [ 679.915880] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 679.915880] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 679.915880] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52957432-6bd2-4398-9f34-9ffc9e00b685 with Priority: HIGHEST for action port [ 679.916474] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.916474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.916590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.916794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.916867] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.917772] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.917889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.917958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.919390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.919390] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.919390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.919390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.919390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.919390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.919390] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.920169] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-52957432-6bd2-4398-9f34-9ffc9e00b685 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.920169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.920169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.920169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.920169] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52957432-6bd2-4398-9f34-9ffc9e00b685',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.996185] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7153ad46-a5d2-4759-8845-e3ebdc407f43 None None] Enqueued Resource ID: e48f07f4-ed5e-4e4c-bee7-77acdf74a82b with Priority: HIGHEST for action port [ 679.999074] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e48f07f4-ed5e-4e4c-bee7-77acdf74a82b with Priority: HIGHEST for action port [ 679.999376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e48f07f4-ed5e-4e4c-bee7-77acdf74a82b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.999674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e48f07f4-ed5e-4e4c-bee7-77acdf74a82b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.999674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e48f07f4-ed5e-4e4c-bee7-77acdf74a82b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.999929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e48f07f4-ed5e-4e4c-bee7-77acdf74a82b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.000036] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e48f07f4-ed5e-4e4c-bee7-77acdf74a82b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.422341] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.425431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.425431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.425431] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52957432-6bd2-4398-9f34-9ffc9e00b685 with status ACTIVE [ 680.425431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.425730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.425730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.426096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.426096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.426096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.426096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.426266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.426300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.426520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.426621] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.426716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.426774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.426917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.426992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.427085] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52957432-6bd2-4398-9f34-9ffc9e00b685 is going to be updated. [ 680.451262] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.451262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.451262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.451262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.451262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.451883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52957432-6bd2-4398-9f34-9ffc9e00b685" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.503534] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e48f07f4-ed5e-4e4c-bee7-77acdf74a82b [ 680.505588] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.505588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.505588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.505588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.505588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.505588] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e48f07f4-ed5e-4e4c-bee7-77acdf74a82b already deleted. [ 680.505588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e48f07f4-ed5e-4e4c-bee7-77acdf74a82b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.799696] env[69219]: INFO networking_nsxv3.common.synchronization [req-44130b76-4a84-4f75-9895-f47d0bcef3fb req-4c191f41-0db3-4500-b6fd-92709b330d1b tempest-ServerDiagnosticsTest-1755697257 tempest-ServerDiagnosticsTest-1755697257-project-member] Enqueued Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_members [ 680.800263] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGHEST for action security_group_members [ 680.800596] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.800720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.800789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.800988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.801317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.801440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.801505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.802971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.803092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.803202] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.925673] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.305540] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.305768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.305850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.306972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.306972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.306972] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.306972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.306972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.306972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.307499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.307499] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f349768-69c7-4906-9f16-20b4268d8357 is going to be updated. [ 681.333123] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.333281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.333349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.333561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.333706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.343243] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f349768-69c7-4906-9f16-20b4268d8357 in Status: IN_PROGRESS for 2s [ 681.429323] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.429455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.429455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.429722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.429722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.429809] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be created. [ 681.456055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.456055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.456055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.456348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.456430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.465192] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: UNINITIALIZED for 2s [ 682.347822] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5bf30ec9-7417-49f3-8e57-f37a8091d066 None None] Enqueued Resource ID: e912652c-9ae3-4771-a755-15f528a5e9fa with Priority: HIGHEST for action port [ 682.348351] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e912652c-9ae3-4771-a755-15f528a5e9fa with Priority: HIGHEST for action port [ 682.348725] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e912652c-9ae3-4771-a755-15f528a5e9fa taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.348831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e912652c-9ae3-4771-a755-15f528a5e9fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.348942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e912652c-9ae3-4771-a755-15f528a5e9fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.350899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e912652c-9ae3-4771-a755-15f528a5e9fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.351045] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e912652c-9ae3-4771-a755-15f528a5e9fa',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.853422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e912652c-9ae3-4771-a755-15f528a5e9fa [ 682.853652] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.853787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.853855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.854088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.854184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.854265] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e912652c-9ae3-4771-a755-15f528a5e9fa already deleted. [ 682.854985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e912652c-9ae3-4771-a755-15f528a5e9fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.091132] env[69219]: INFO networking_nsxv3.common.synchronization [req-90d3d9ee-833b-4beb-ab9b-486a726cc208 req-27f6e3a3-8929-4095-8133-2f17b0f6992d tempest-ServerDiagnosticsNegativeTest-638019795 tempest-ServerDiagnosticsNegativeTest-638019795-project-member] Enqueued Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_members [ 683.092225] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_members [ 683.092568] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.092746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.093730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.094032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.094355] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.096965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.096965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.097124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.097282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.097756] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.354821] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f349768-69c7-4906-9f16-20b4268d8357 in Status: SUCCESS [ 683.355142] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f349768-69c7-4906-9f16-20b4268d8357 deletion is rescheduled due to dependency. [ 683.355142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.477100] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 683.477524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.477729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.478367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.478367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.478554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.478634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.479162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.479162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.479370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.479543] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.599418] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.599572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.599639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.600127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.600127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.600242] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.600310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.600347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.600647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.600750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.600846] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 already deleted. [ 683.600930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.658129] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.658591] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.658951] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.659586] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.660318] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.660803] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.660912] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.661437] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.661609] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.662620] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.662620] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.662620] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.662620] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.662863] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.662938] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.663103] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.680938] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.681078] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.681271] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.681399] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.681737] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-da179f11-ca3d-4194-a4a4-66b24aafc8c3 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.681924] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.682105] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.682720] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.682720] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da179f11-ca3d-4194-a4a4-66b24aafc8c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.988030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.988030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.988030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.988030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.988030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.988789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.988789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.988789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.988789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.988789] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.186028] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.186228] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.186360] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.186662] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.186816] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.186976] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port da179f11-ca3d-4194-a4a4-66b24aafc8c3 not found, creating... [ 684.187260] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.187422] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.187547] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.187755] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.187899] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.188217] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.188383] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.188502] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.188714] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.189523] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.189688] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: da179f11-ca3d-4194-a4a4-66b24aafc8c3 is going to be created. [ 684.211159] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.211393] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.211532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.211826] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.214066] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.214411] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.312035] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2bb91df7-5f7a-4d4b-a12f-02d4fbb29fce None None] Enqueued Resource ID: 474c0239-ba96-47c7-985a-65179e30e4c3 with Priority: HIGHEST for action port [ 684.312300] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 474c0239-ba96-47c7-985a-65179e30e4c3 with Priority: HIGHEST for action port [ 684.312895] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-474c0239-ba96-47c7-985a-65179e30e4c3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.312969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-474c0239-ba96-47c7-985a-65179e30e4c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.313169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-474c0239-ba96-47c7-985a-65179e30e4c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.315959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-474c0239-ba96-47c7-985a-65179e30e4c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.315959] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('474c0239-ba96-47c7-985a-65179e30e4c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.491157] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df327ac5-73cd-478c-b19b-3849894e070d: rpc.has_security_group_logging(os_id): False [ 684.511102] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.512025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.516101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.516101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.516101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.516368] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.516368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.516368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.516494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.516609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.516862] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.516862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.516993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.517396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.517564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.518161] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.518275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.518382] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.521032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.521147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.521227] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be created. [ 684.573440] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.573569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.573614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.573809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.574012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.585029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 684.816366] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 474c0239-ba96-47c7-985a-65179e30e4c3 [ 684.819168] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.819168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.819168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.819168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.819168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.819168] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:474c0239-ba96-47c7-985a-65179e30e4c3 already deleted. [ 684.819168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-474c0239-ba96-47c7-985a-65179e30e4c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.323258] env[69219]: INFO networking_nsxv3.common.synchronization [req-90d3d9ee-833b-4beb-ab9b-486a726cc208 req-f0a3222d-9c76-4f95-b736-4d5594bf7757 service nova] Enqueued Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_rules [ 685.323342] env[69219]: INFO networking_nsxv3.common.synchronization [req-90d3d9ee-833b-4beb-ab9b-486a726cc208 req-f0a3222d-9c76-4f95-b736-4d5594bf7757 service nova] Enqueued Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_members [ 685.323431] env[69219]: INFO networking_nsxv3.common.synchronization [req-90d3d9ee-833b-4beb-ab9b-486a726cc208 req-f0a3222d-9c76-4f95-b736-4d5594bf7757 service nova] Enqueued Resource ID: da179f11-ca3d-4194-a4a4-66b24aafc8c3 with Priority: HIGHEST for action port [ 685.323735] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_rules [ 685.323794] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_members [ 685.324339] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da179f11-ca3d-4194-a4a4-66b24aafc8c3 with Priority: HIGHEST for action port [ 685.324471] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.324625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.324680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.324912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.324980] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.328405] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.328405] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.328405] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.328746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.328746] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.328746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.328746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.328932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.328966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.329070] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.330012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-da179f11-ca3d-4194-a4a4-66b24aafc8c3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.330326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.330326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.330326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.330480] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da179f11-ca3d-4194-a4a4-66b24aafc8c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.392346] env[69219]: INFO networking_nsxv3.common.synchronization [req-729d9884-919b-4866-8fbd-95b67d0fa146 req-ed9976e4-6767-4552-a3a3-11a41265eca1 tempest-FloatingIPsAssociationTestJSON-828494427 tempest-FloatingIPsAssociationTestJSON-828494427-project-member] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 685.392653] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 685.392962] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.395395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.395395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.396833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.397045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.397169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.397246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.397426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.397551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.397635] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.770123] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.770537] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.770537] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.770823] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.771495] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.771690] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.771920] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.772435] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.772435] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.772662] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.772813] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.772935] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.773121] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.773245] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 685.773376] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.773547] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.799886] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.800063] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 685.800255] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.800417] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.800737] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9e7e92bf-e3e8-4128-aa88-c8977d55d258 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.800916] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.801053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.801419] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.801578] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e7e92bf-e3e8-4128-aa88-c8977d55d258',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.834373] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.834373] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.834373] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da179f11-ca3d-4194-a4a4-66b24aafc8c3 with status ACTIVE [ 685.834373] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.834373] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.834373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.836578] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.837524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.840793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.840793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.840793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.840793] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da179f11-ca3d-4194-a4a4-66b24aafc8c3 is going to be updated. [ 685.862066] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.862066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.862066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.862280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.862280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.862411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da179f11-ca3d-4194-a4a4-66b24aafc8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.902884] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.902884] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.902884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.902884] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 already deleted. [ 685.905269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.305072] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.305744] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.306247] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.306599] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.307113] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.307668] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9e7e92bf-e3e8-4128-aa88-c8977d55d258 not found, creating... [ 686.308319] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.309097] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.309097] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.309613] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.309866] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.310555] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.310814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.311159] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.311320] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.311554] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.311776] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9e7e92bf-e3e8-4128-aa88-c8977d55d258 is going to be created. [ 686.335385] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.335610] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.335733] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.336037] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.336275] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.336510] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.341304] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.602669] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 686.602669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.845283] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.845893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.845893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.845893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.845893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.846357] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 is going to be created. [ 686.871739] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.872049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.872194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.872463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.872586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.882756] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 in Status: UNINITIALIZED for 2s [ 687.284254] env[69219]: INFO networking_nsxv3.common.synchronization [req-729d9884-919b-4866-8fbd-95b67d0fa146 req-9180c0d8-321c-4f04-b9bd-486871d3344d service nova] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_rules [ 687.284254] env[69219]: INFO networking_nsxv3.common.synchronization [req-729d9884-919b-4866-8fbd-95b67d0fa146 req-9180c0d8-321c-4f04-b9bd-486871d3344d service nova] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 687.284254] env[69219]: INFO networking_nsxv3.common.synchronization [req-729d9884-919b-4866-8fbd-95b67d0fa146 req-9180c0d8-321c-4f04-b9bd-486871d3344d service nova] Enqueued Resource ID: 9e7e92bf-e3e8-4128-aa88-c8977d55d258 with Priority: HIGHEST for action port [ 687.284254] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_rules [ 687.284254] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 687.284254] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e7e92bf-e3e8-4128-aa88-c8977d55d258 with Priority: HIGHEST for action port [ 687.284254] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.284254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.284254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.284254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.285417] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.288556] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.288556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.288556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.288705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.289143] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.289143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.289143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.289280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.289328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.289409] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.290455] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e7e92bf-e3e8-4128-aa88-c8977d55d258 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.290455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.290455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.290687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.290687] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e7e92bf-e3e8-4128-aa88-c8977d55d258',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.792580] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.792580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.792789] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.799549] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e7e92bf-e3e8-4128-aa88-c8977d55d258 with status ACTIVE [ 687.800154] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.800318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.800388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.800606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.800702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.800911] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.801032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.801183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.801254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.801332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.801515] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.801612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.801675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.801815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.801891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.801977] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e7e92bf-e3e8-4128-aa88-c8977d55d258 is going to be updated. [ 687.823517] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.823737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.823812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.823992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.824174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.824431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e7e92bf-e3e8-4128-aa88-c8977d55d258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.295440] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.356846] env[69219]: INFO networking_nsxv3.common.synchronization [None req-04a69cb3-4d69-4dd5-a793-186cf44735c1 None None] Enqueued Resource ID: 17c24c74-1c47-4b33-8f56-c8ed068c233a with Priority: HIGHEST for action port [ 688.357114] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17c24c74-1c47-4b33-8f56-c8ed068c233a with Priority: HIGHEST for action port [ 688.357679] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-17c24c74-1c47-4b33-8f56-c8ed068c233a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.357835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17c24c74-1c47-4b33-8f56-c8ed068c233a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.357880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17c24c74-1c47-4b33-8f56-c8ed068c233a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.359483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17c24c74-1c47-4b33-8f56-c8ed068c233a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.359483] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c24c74-1c47-4b33-8f56-c8ed068c233a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.806009] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.806009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.806009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.808810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.808810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.808810] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be created. [ 688.846886] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.846886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.846886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.846886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.846886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.859080] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: UNINITIALIZED for 2s [ 688.863966] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17c24c74-1c47-4b33-8f56-c8ed068c233a [ 688.863966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.863966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.863966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.863966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.864516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.864835] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17c24c74-1c47-4b33-8f56-c8ed068c233a already deleted. [ 688.868286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17c24c74-1c47-4b33-8f56-c8ed068c233a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.897963] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 in Status: SUCCESS [ 688.898264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.898452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.898666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.898860] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.898982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.899068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.899282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.899380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.899431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.899534] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.941077] env[69219]: INFO networking_nsxv3.common.synchronization [req-0eff6bc9-9d2f-417a-a45c-eeb6e0588749 req-6a240b03-3f3e-417f-b546-e1772d329fed tempest-FloatingIPsAssociationNegativeTestJSON-1139219605 tempest-FloatingIPsAssociationNegativeTestJSON-1139219605-project-member] Enqueued Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_members [ 688.941769] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGHEST for action security_group_members [ 688.942228] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.942493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.942657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.942939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.943237] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.943522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.945134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.945134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.945134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.945134] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.402164] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.402436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.402436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.402997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.402997] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.402997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.402997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.403419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.403419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.403419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.403608] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.403666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.403763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.403907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.403982] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.404463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.404463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.404463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.404463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.404463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.404660] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.450385] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.450385] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.450385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.450385] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce450239-c791-4c8d-86b2-a1dd86547bbc is going to be updated. [ 689.478082] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.478082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.478681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.478681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.478681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.489692] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce450239-c791-4c8d-86b2-a1dd86547bbc in Status: IN_PROGRESS for 2s [ 689.588617] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5168bf2b-ed90-480a-b8de-77c4604b3543 tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 689.592437] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 689.592437] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.592437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.592437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.592437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.592437] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.682819] env[69219]: INFO networking_nsxv3.common.synchronization [None req-eb781c47-39d6-4d70-b501-5e9d532022f4 tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 689.683406] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 689.683771] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.684043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.912281] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62d3be3f-2845-4a57-b242-e49996f8eac5: rpc.has_security_group_logging(os_id): False [ 689.929515] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.929943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.932018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.932018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.932018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.932018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.932985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.932985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.934331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.934331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.934331] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 is going to be created. [ 689.990344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.993021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.993021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.993021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.993021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.009676] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 in Status: IN_PROGRESS for 2s [ 690.119078] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.119078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.119078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.121420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.121420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.121420] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c47700-2196-4adc-afd5-b72e818055ee already deleted. [ 690.121420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.121420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.121420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.121420] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.626612] env[69219]: INFO networking_nsxv3.common.synchronization [req-de3af964-ea19-44bd-82f6-760bb40edff4 req-5acfed9f-b715-46c7-97da-7bc124171d85 tempest-ServersWithSpecificFlavorTestJSON-1490539426 tempest-ServersWithSpecificFlavorTestJSON-1490539426-project-member] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 690.626612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 690.626612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.626612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.626612] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.626612] env[69219]: INFO networking_nsxv3.common.synchronization [None req-b1fedf87-f44c-4a1f-9b86-416e990eee81 None None] Enqueued Resource ID: 704b1fd1-f209-4d0a-bce6-67367979f609 with Priority: HIGHEST for action port [ 690.626612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704b1fd1-f209-4d0a-bce6-67367979f609 with Priority: HIGHEST for action port [ 690.626612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-704b1fd1-f209-4d0a-bce6-67367979f609 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704b1fd1-f209-4d0a-bce6-67367979f609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704b1fd1-f209-4d0a-bce6-67367979f609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.626612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704b1fd1-f209-4d0a-bce6-67367979f609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.626612] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704b1fd1-f209-4d0a-bce6-67367979f609',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.651948] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.653910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.654318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.654849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.654849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.655060] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c47700-2196-4adc-afd5-b72e818055ee already deleted. [ 690.656442] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.842589] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5d3f35a0-1bf2-4aa8-a596-d49e4f7ed276 None None] Enqueued Resource ID: 0d952272-50b1-4830-b884-7f1af4ba2a12 with Priority: HIGHEST for action port [ 690.843193] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d952272-50b1-4830-b884-7f1af4ba2a12 with Priority: HIGHEST for action port [ 690.843471] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d952272-50b1-4830-b884-7f1af4ba2a12 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.844206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d952272-50b1-4830-b884-7f1af4ba2a12" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.844683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d952272-50b1-4830-b884-7f1af4ba2a12" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.844939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d952272-50b1-4830-b884-7f1af4ba2a12" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.845059] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d952272-50b1-4830-b884-7f1af4ba2a12',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.871049] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: SUCCESS [ 690.871049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.871049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.871049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.871049] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.871049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.871049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.871049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.871629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.871629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.871629] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.029492] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.029681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.029735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.029946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.030071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.030277] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.030379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.030437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.030623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.030707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.030788] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 already deleted. [ 691.030867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.031121] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 704b1fd1-f209-4d0a-bce6-67367979f609 [ 691.031276] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.031371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.031431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.031576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.031654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.031745] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:704b1fd1-f209-4d0a-bce6-67367979f609 already deleted. [ 691.031813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704b1fd1-f209-4d0a-bce6-67367979f609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.351956] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d952272-50b1-4830-b884-7f1af4ba2a12 [ 691.351956] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.351956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.351956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.351956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.352300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.352300] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d952272-50b1-4830-b884-7f1af4ba2a12 already deleted. [ 691.352300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d952272-50b1-4830-b884-7f1af4ba2a12" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.374729] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.374915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.374962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.376318] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.376318] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.376318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.376709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.377888] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.377888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.377888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.377888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.378132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.378132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.378132] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.402544] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.402767] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.402896] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.403242] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.403525] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.403714] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.403850] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.404924] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.405118] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.405332] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.405453] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.405560] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.405664] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.405768] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.405868] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.406148] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.437248] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.437248] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 691.437248] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.437248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.437248] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.437248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.437248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.437248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.437248] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('850c8e3b-22e7-46ca-8d45-3dff6f7a48f7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.501222] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce450239-c791-4c8d-86b2-a1dd86547bbc in Status: SUCCESS [ 691.501222] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce450239-c791-4c8d-86b2-a1dd86547bbc deletion is rescheduled due to dependency. [ 691.501646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.880644] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04ba1205-02a7-4968-99ca-25d19305f8e9: rpc.has_security_group_logging(os_id): False [ 691.899821] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.899821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.899821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.899821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.900131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.900131] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.900227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.900227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.900617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.900617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.900751] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.900830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.900891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.901056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.901135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.901323] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.901425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.901472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.901612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.901714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.901753] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be created. [ 691.940980] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.941329] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.942121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.942121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.942204] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.942333] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 not found, creating... [ 691.942865] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.944156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.944156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.944156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.944156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.944307] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.944426] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.944544] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.944762] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.944900] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.945063] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 is going to be created. [ 691.962316] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.962666] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.962803] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.963111] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.963353] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.963593] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.967271] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.967544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.967544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.967750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.967833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.980889] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: IN_PROGRESS for 2s [ 692.043085] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 in Status: SUCCESS [ 692.044049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.834204] env[69219]: INFO networking_nsxv3.common.synchronization [req-de3af964-ea19-44bd-82f6-760bb40edff4 req-384214f2-d0e6-4b3c-9e6f-426d991f0590 service nova] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 692.834204] env[69219]: INFO networking_nsxv3.common.synchronization [req-de3af964-ea19-44bd-82f6-760bb40edff4 req-384214f2-d0e6-4b3c-9e6f-426d991f0590 service nova] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 692.834204] env[69219]: INFO networking_nsxv3.common.synchronization [req-de3af964-ea19-44bd-82f6-760bb40edff4 req-384214f2-d0e6-4b3c-9e6f-426d991f0590 service nova] Enqueued Resource ID: 850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 with Priority: HIGHEST for action port [ 692.834204] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 692.834204] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 692.834204] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 with Priority: HIGHEST for action port [ 692.834204] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.838069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.838258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.838481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.838570] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.839538] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.839770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.839770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.840153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.840153] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.840278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.840278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.840401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.840484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.840576] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.842837] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.842837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.842837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.842837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.842837] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('850c8e3b-22e7-46ca-8d45-3dff6f7a48f7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.188340] env[69219]: INFO networking_nsxv3.common.synchronization [req-566798bb-b43d-40ce-96bd-295bdd26e8da req-66c94a9f-b1a7-4c8f-9ee4-277599a8edfb tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 693.189990] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 693.190216] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.190370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.190451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.190755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.190929] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.191103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.191198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.191396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.191483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.191537] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.344255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.344255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.345128] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.345947] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 with status ACTIVE [ 693.346148] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.346322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.346322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.346692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.346692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.346835] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.346937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.347037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.347165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.347500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.349502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.349585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.349636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.350110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.350110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.350110] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 850c8e3b-22e7-46ca-8d45-3dff6f7a48f7 is going to be updated. [ 693.382571] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.382571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.382571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.382832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.382832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.382942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-850c8e3b-22e7-46ca-8d45-3dff6f7a48f7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.456618] env[69219]: INFO networking_nsxv3.common.synchronization [None req-9aef509c-c1c3-4722-9dd1-1a5ee8377956 None None] Enqueued Resource ID: c921a11a-851c-4c23-b24f-686cf0d2f0f5 with Priority: HIGHEST for action port [ 693.456880] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c921a11a-851c-4c23-b24f-686cf0d2f0f5 with Priority: HIGHEST for action port [ 693.457803] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c921a11a-851c-4c23-b24f-686cf0d2f0f5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.457941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c921a11a-851c-4c23-b24f-686cf0d2f0f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.457998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c921a11a-851c-4c23-b24f-686cf0d2f0f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.460943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c921a11a-851c-4c23-b24f-686cf0d2f0f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.460943] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c921a11a-851c-4c23-b24f-686cf0d2f0f5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.632482] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-70 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.632671] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.632791] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.633144] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.633474] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.633641] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.633754] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.633965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.635239] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.635465] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.635589] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.635937] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.635937] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.635937] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.636094] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.636162] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.656042] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.656554] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.656641] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.656846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.657191] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b2734458-b9e2-4bf5-a269-1e020003dcdc taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.657427] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.657519] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.657886] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.658396] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2734458-b9e2-4bf5-a269-1e020003dcdc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.693580] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.693765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.693815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.695991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.695991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.695991] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.695991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.695991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.695991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.695991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.695991] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 already deleted. [ 693.695991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.851926] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.963238] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c921a11a-851c-4c23-b24f-686cf0d2f0f5 [ 693.963772] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.963772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.963772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.963983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.964320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.964320] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c921a11a-851c-4c23-b24f-686cf0d2f0f5 already deleted. [ 693.964320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c921a11a-851c-4c23-b24f-686cf0d2f0f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.996633] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: SUCCESS [ 693.996797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.164967] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.164967] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b2734458-b9e2-4bf5-a269-1e020003dcdc not found, creating... [ 694.164967] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.164967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.165445] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.165445] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.165445] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.165445] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.165445] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.165445] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b2734458-b9e2-4bf5-a269-1e020003dcdc is going to be created. [ 694.186791] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.188861] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.188861] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.188861] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.188861] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.188861] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.317172] env[69219]: INFO networking_nsxv3.common.synchronization [None req-23ae3235-9b83-4323-b7ae-4cb3c5e8686d None None] Enqueued Resource ID: 89d08484-836b-4ae2-bd13-a4e147213a3c with Priority: HIGHEST for action port [ 694.317172] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89d08484-836b-4ae2-bd13-a4e147213a3c with Priority: HIGHEST for action port [ 694.318348] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-89d08484-836b-4ae2-bd13-a4e147213a3c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.318527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89d08484-836b-4ae2-bd13-a4e147213a3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.318608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89d08484-836b-4ae2-bd13-a4e147213a3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.318882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89d08484-836b-4ae2-bd13-a4e147213a3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.318972] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d08484-836b-4ae2-bd13-a4e147213a3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.357130] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.357288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.357356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.357746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.357746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.357746] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 is going to be created. [ 694.387087] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.387284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.387320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.387510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.387673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.405926] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: UNINITIALIZED for 2s [ 694.823908] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89d08484-836b-4ae2-bd13-a4e147213a3c [ 694.823908] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.823908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.823908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.823908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.823908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.823908] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89d08484-836b-4ae2-bd13-a4e147213a3c already deleted. [ 694.823908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89d08484-836b-4ae2-bd13-a4e147213a3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.080094] env[69219]: INFO networking_nsxv3.common.synchronization [req-566798bb-b43d-40ce-96bd-295bdd26e8da req-018923a7-8e56-434a-8301-5f3bee9c8ba5 service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 695.080305] env[69219]: INFO networking_nsxv3.common.synchronization [req-566798bb-b43d-40ce-96bd-295bdd26e8da req-018923a7-8e56-434a-8301-5f3bee9c8ba5 service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 695.080460] env[69219]: INFO networking_nsxv3.common.synchronization [req-566798bb-b43d-40ce-96bd-295bdd26e8da req-018923a7-8e56-434a-8301-5f3bee9c8ba5 service nova] Enqueued Resource ID: b2734458-b9e2-4bf5-a269-1e020003dcdc with Priority: HIGHEST for action port [ 695.080717] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 695.081545] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 695.081545] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2734458-b9e2-4bf5-a269-1e020003dcdc with Priority: HIGHEST for action port [ 695.081545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.081781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.081781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.081903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.082920] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.084242] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.084331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.084399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.084569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.084713] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.084859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.084859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.084997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.085090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.085176] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.089183] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2734458-b9e2-4bf5-a269-1e020003dcdc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.089183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.089183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.089183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.089183] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2734458-b9e2-4bf5-a269-1e020003dcdc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.590948] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.591319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.591319] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.593671] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2734458-b9e2-4bf5-a269-1e020003dcdc with status ACTIVE [ 695.593671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.593671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.593671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.593671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.594408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.594515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.594570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.594775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.594866] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2734458-b9e2-4bf5-a269-1e020003dcdc is going to be updated. [ 695.615101] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.615581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.615784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.616477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.616477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.616477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2734458-b9e2-4bf5-a269-1e020003dcdc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.098153] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.416420] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: SUCCESS [ 696.417757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.417912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.418177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.419300] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.419300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.419452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.419625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.419625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.419865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.419865] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.601057] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.604014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.604014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.604014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.604014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.604014] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be created. [ 696.636430] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.636430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.636430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.636430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.636430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.644553] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: UNINITIALIZED for 2s [ 696.922177] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.179734] env[69219]: INFO networking_nsxv3.common.synchronization [None req-ff2ec794-ee7b-42fe-bab7-688c3f7e8b73 None None] Enqueued Resource ID: 407b3fce-1dcc-4114-bc0f-3386911ae22b with Priority: HIGHEST for action port [ 697.179734] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 407b3fce-1dcc-4114-bc0f-3386911ae22b with Priority: HIGHEST for action port [ 697.179734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-407b3fce-1dcc-4114-bc0f-3386911ae22b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.179734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-407b3fce-1dcc-4114-bc0f-3386911ae22b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.179734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-407b3fce-1dcc-4114-bc0f-3386911ae22b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.180460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-407b3fce-1dcc-4114-bc0f-3386911ae22b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.180742] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('407b3fce-1dcc-4114-bc0f-3386911ae22b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.424818] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd4746a8-624d-411a-b8a7-b5c965021a51: rpc.has_security_group_logging(os_id): False [ 697.442050] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.447029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.447029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.447029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 is going to be created. [ 697.470226] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4cd68a95-ad53-4c52-85a2-d145d35399b6 None None] Enqueued Resource ID: ed581ea5-180b-426e-b1e1-9d0c0044a557 with Priority: HIGHEST for action port [ 697.470404] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed581ea5-180b-426e-b1e1-9d0c0044a557 with Priority: HIGHEST for action port [ 697.470854] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed581ea5-180b-426e-b1e1-9d0c0044a557 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.471294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed581ea5-180b-426e-b1e1-9d0c0044a557" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.471596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed581ea5-180b-426e-b1e1-9d0c0044a557" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.471987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed581ea5-180b-426e-b1e1-9d0c0044a557" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.472477] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed581ea5-180b-426e-b1e1-9d0c0044a557',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.499393] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.499961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.502025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.502025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.502025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.518581] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: IN_PROGRESS for 2s [ 697.685378] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 407b3fce-1dcc-4114-bc0f-3386911ae22b [ 697.685993] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.685993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.685993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.686404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.686404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.686824] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:407b3fce-1dcc-4114-bc0f-3386911ae22b already deleted. [ 697.686824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-407b3fce-1dcc-4114-bc0f-3386911ae22b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.975442] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed581ea5-180b-426e-b1e1-9d0c0044a557 [ 697.975692] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.975829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.975895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.976144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.976227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.976331] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed581ea5-180b-426e-b1e1-9d0c0044a557 already deleted. [ 697.976448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed581ea5-180b-426e-b1e1-9d0c0044a557" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.655891] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 698.656299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.657103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.657103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.657103] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.657487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.657487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.657629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.657830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.657902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.658027] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.161194] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.161576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.161576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.161714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.162187] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.162482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.162482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.162658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.162717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.162767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.162932] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.163037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.164195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.164195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.164195] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.164195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.164195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.164195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.164195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.164195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.164195] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.529226] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: SUCCESS [ 699.529384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.614091] env[69219]: INFO networking_nsxv3.common.synchronization [req-2824e3b8-f87f-420b-bac6-3f3d65e2e04b req-a14a6c49-0b5b-4938-a84f-a2f835201a43 tempest-ServerDiagnosticsNegativeTest-638019795 tempest-ServerDiagnosticsNegativeTest-638019795-project-member] Enqueued Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_members [ 699.614908] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGHEST for action security_group_members [ 699.614908] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.615103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.615103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.615383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.615527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.615586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.615690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.617108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.617108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.617108] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.666682] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 699.674033] env[69219]: INFO networking_nsxv3.common.synchronization [req-f89ebca7-8b53-4c0e-9757-3b80137bf0eb req-382d52e1-641d-47b6-b046-c995fd2120dd tempest-TenantUsagesTestJSON-1976364789 tempest-TenantUsagesTestJSON-1976364789-project-member] Enqueued Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_members [ 699.674708] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_members [ 699.675018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.675270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.675331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.675672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.675792] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.675899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.676534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.676534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.676534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.676534] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.686024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.686024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.686024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.686024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.686872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.687179] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.687403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.687552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.687781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.687944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.688152] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be created. [ 699.746842] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.746989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.747168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.747371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.747474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.757175] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 700.047208] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.047414] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.047661] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.047970] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.048701] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.048882] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.050453] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.050956] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.051388] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.052090] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.053410] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.053410] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.053410] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.053410] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.053410] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.053410] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.080662] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.080907] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.081103] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.081549] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.082076] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-bbef6de5-8796-45b4-8a09-b86557702dbb taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.082347] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.082555] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.082858] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.083017] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbef6de5-8796-45b4-8a09-b86557702dbb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.118784] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.118987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.119108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.119381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.119527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.119765] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.119868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.119938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.120252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.120342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.120436] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 is going to be updated. [ 700.146702] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.146826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.146826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.147011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.147159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.156048] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 in Status: IN_PROGRESS for 2s [ 700.180514] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.180514] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.180514] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c already deleted. [ 700.180514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.435217] env[69219]: INFO networking_nsxv3.common.synchronization [None req-a939a728-9606-4191-86fa-22b3ab714969 None None] Enqueued Resource ID: 200141d9-5a05-4593-866f-7417780aefed with Priority: HIGHEST for action port [ 700.435217] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200141d9-5a05-4593-866f-7417780aefed with Priority: HIGHEST for action port [ 700.435217] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-200141d9-5a05-4593-866f-7417780aefed taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.435217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-200141d9-5a05-4593-866f-7417780aefed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.435217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-200141d9-5a05-4593-866f-7417780aefed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.435557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-200141d9-5a05-4593-866f-7417780aefed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.435805] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('200141d9-5a05-4593-866f-7417780aefed',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.589225] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.589225] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port bbef6de5-8796-45b4-8a09-b86557702dbb not found, creating... [ 700.589225] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.589225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.589720] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.589720] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.589720] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.589720] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.590340] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.590823] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: bbef6de5-8796-45b4-8a09-b86557702dbb is going to be created. [ 700.616484] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.616756] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.616916] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.617248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.617524] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.617801] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.939496] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 200141d9-5a05-4593-866f-7417780aefed [ 700.939496] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.939496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.939496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.940026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.940136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.940188] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:200141d9-5a05-4593-866f-7417780aefed already deleted. [ 700.940273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-200141d9-5a05-4593-866f-7417780aefed" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.258912] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2a80ba99-47ce-4969-984f-11f534aa84d2 None None] Enqueued Resource ID: 234e5b8c-c10f-4847-9727-2daf7cf5f7b7 with Priority: HIGHEST for action port [ 701.260819] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 234e5b8c-c10f-4847-9727-2daf7cf5f7b7 with Priority: HIGHEST for action port [ 701.261191] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-234e5b8c-c10f-4847-9727-2daf7cf5f7b7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.261715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-234e5b8c-c10f-4847-9727-2daf7cf5f7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.261715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-234e5b8c-c10f-4847-9727-2daf7cf5f7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.261715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-234e5b8c-c10f-4847-9727-2daf7cf5f7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.261715] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('234e5b8c-c10f-4847-9727-2daf7cf5f7b7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.381656] env[69219]: INFO networking_nsxv3.common.synchronization [req-f89ebca7-8b53-4c0e-9757-3b80137bf0eb req-760405ad-5b67-4d3e-9426-8a2b5432dd61 service nova] Enqueued Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_rules [ 701.382017] env[69219]: INFO networking_nsxv3.common.synchronization [req-f89ebca7-8b53-4c0e-9757-3b80137bf0eb req-760405ad-5b67-4d3e-9426-8a2b5432dd61 service nova] Enqueued Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_members [ 701.382017] env[69219]: INFO networking_nsxv3.common.synchronization [req-f89ebca7-8b53-4c0e-9757-3b80137bf0eb req-760405ad-5b67-4d3e-9426-8a2b5432dd61 service nova] Enqueued Resource ID: bbef6de5-8796-45b4-8a09-b86557702dbb with Priority: HIGHEST for action port [ 701.384899] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_rules [ 701.385062] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_members [ 701.385191] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbef6de5-8796-45b4-8a09-b86557702dbb with Priority: HIGHEST for action port [ 701.385603] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.385732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.385799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.386107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.386226] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.387189] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.387359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.387469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.387758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.387808] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.387912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.387975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.388133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.388222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.388335] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.389735] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbef6de5-8796-45b4-8a09-b86557702dbb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.389735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.389735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.389735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.389735] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbef6de5-8796-45b4-8a09-b86557702dbb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.763695] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 234e5b8c-c10f-4847-9727-2daf7cf5f7b7 [ 701.764531] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.764531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.764531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.764725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.764725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.764788] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:234e5b8c-c10f-4847-9727-2daf7cf5f7b7 already deleted. [ 701.764822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-234e5b8c-c10f-4847-9727-2daf7cf5f7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.771171] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 701.771171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.896426] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.898370] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.898486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.898674] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbef6de5-8796-45b4-8a09-b86557702dbb with status ACTIVE [ 701.898885] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.899057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.899148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.901745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.901841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.902046] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.902152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.903033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.903033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.903033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.903033] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.903033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.903033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.903033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.903422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.903422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbef6de5-8796-45b4-8a09-b86557702dbb is going to be updated. [ 701.923496] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.923672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.923802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.923926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.924072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.924232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbef6de5-8796-45b4-8a09-b86557702dbb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.165527] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 in Status: SUCCESS [ 702.165649] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 deletion is rescheduled due to dependency. [ 702.165744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.406739] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.910335] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.910478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.910556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.910781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.910917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.911046] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c is going to be created. [ 702.936371] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.936371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.936371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.937368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.937368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.946453] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c in Status: UNINITIALIZED for 2s [ 703.408666] env[69219]: INFO networking_nsxv3.common.synchronization [None req-dec65ba3-e058-440d-a647-42c836a7a75a None None] Enqueued Resource ID: 59e15954-6f3e-4b5a-9ca2-e3d673cb9258 with Priority: HIGHEST for action port [ 703.409296] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59e15954-6f3e-4b5a-9ca2-e3d673cb9258 with Priority: HIGHEST for action port [ 703.409952] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-59e15954-6f3e-4b5a-9ca2-e3d673cb9258 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.409952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59e15954-6f3e-4b5a-9ca2-e3d673cb9258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.409952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59e15954-6f3e-4b5a-9ca2-e3d673cb9258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.410403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59e15954-6f3e-4b5a-9ca2-e3d673cb9258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.410551] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59e15954-6f3e-4b5a-9ca2-e3d673cb9258',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.913227] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59e15954-6f3e-4b5a-9ca2-e3d673cb9258 [ 703.913478] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.913618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.913679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.913899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.913991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.914107] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59e15954-6f3e-4b5a-9ca2-e3d673cb9258 already deleted. [ 703.914220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59e15954-6f3e-4b5a-9ca2-e3d673cb9258" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.390920] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-6b5e68d8-1fcc-439b-89eb-821df9af5fc7 tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 704.391529] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 704.391844] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.394162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.394162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.394162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.394162] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.394162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.394162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.394162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.394162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.394525] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.758091] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.758572] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.758572] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.759778] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.760609] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.760609] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.760788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.760993] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.761164] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.761661] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.761661] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.761661] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.761912] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.761912] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 704.761912] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.762123] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.781273] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.781449] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 704.781588] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.781780] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.782129] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-dabdde30-dec0-4101-8be6-159088ea85ae taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.782301] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.782423] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.782873] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.783031] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dabdde30-dec0-4101-8be6-159088ea85ae',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.901230] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.901230] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.901230] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 already deleted. [ 704.901230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.957459] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c in Status: SUCCESS [ 704.957743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.957900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.958105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.958338] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.958443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.958513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.958654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.958757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.958831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.958907] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.079709] env[69219]: INFO networking_nsxv3.common.synchronization [req-9cd4bd84-9e0d-486e-b36d-2e27c5307e0a req-db78b006-9b1f-42e9-912d-5ff9779bef63 tempest-ListServersNegativeTestJSON-476691794 tempest-ListServersNegativeTestJSON-476691794-project-member] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 705.080229] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 705.080671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.080810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.080956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.081117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.081256] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.082188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.082416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.082466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.082700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.082700] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.286156] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.286552] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.286770] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.287216] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.287850] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.287850] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port dabdde30-dec0-4101-8be6-159088ea85ae not found, creating... [ 705.288146] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.288419] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.288612] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.288981] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.289232] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.289699] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.289964] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.290178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.290521] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.290810] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.290979] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: dabdde30-dec0-4101-8be6-159088ea85ae is going to be created. [ 705.311213] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.311551] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.311765] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.312222] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.312589] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.312954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.425068] env[69219]: INFO networking_nsxv3.common.synchronization [req-a1f753ed-c683-4a30-8315-f73d4ae3e990 req-d8d5716b-2c72-4138-ad3b-ae640af3dbfe tempest-ListServersNegativeTestJSON-476691794 tempest-ListServersNegativeTestJSON-476691794-project-member] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 705.425773] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGHEST for action security_group_members [ 705.425773] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.426023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.465020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.465020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.465020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.465020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.465020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.465913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.465913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.465913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.465913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.465913] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.587897] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.967561] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93dbd604-991d-4cfe-98b5-8b882a4f169c: rpc.has_security_group_logging(os_id): False [ 705.987879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.988096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.988452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.988706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.988805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.989113] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.989422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.989422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.989614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.989698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.989900] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.990022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.992639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.992639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.992791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.992850] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.992961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.993022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.993183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.993262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.993421] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c is going to be created. [ 706.031887] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-1565c731-47fb-49c4-a476-8159bc25b668 service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 706.032105] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-1565c731-47fb-49c4-a476-8159bc25b668 service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 706.032264] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-1565c731-47fb-49c4-a476-8159bc25b668 service nova] Enqueued Resource ID: dabdde30-dec0-4101-8be6-159088ea85ae with Priority: HIGHEST for action port [ 706.032496] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 706.032666] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 706.032840] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dabdde30-dec0-4101-8be6-159088ea85ae with Priority: HIGHEST for action port [ 706.033537] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.033635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.033635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.033871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.033958] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.034865] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.034976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.038046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.038046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.038046] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.038046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.038046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.038046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.038046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.038046] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.038046] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-dabdde30-dec0-4101-8be6-159088ea85ae taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.040971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.041113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.041251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.041345] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dabdde30-dec0-4101-8be6-159088ea85ae',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.045269] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.045269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.045269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.045269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.045583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.057029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c in Status: IN_PROGRESS for 2s [ 706.087593] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.543396] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.544508] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.544644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.544861] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dabdde30-dec0-4101-8be6-159088ea85ae with status ACTIVE [ 706.544950] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.545078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.545148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.545319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.545401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.545574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.545678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.545736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.545868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.545939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.549491] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.549619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.549675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.549859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.549941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.550047] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dabdde30-dec0-4101-8be6-159088ea85ae is going to be updated. [ 706.571704] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.571922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.571922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.572111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.572227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.572422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dabdde30-dec0-4101-8be6-159088ea85ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.589815] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.590134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.590134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.590373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.590373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.590507] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 706.649484] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.649627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.649695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.649899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.650050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.658950] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 707.053425] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.556749] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.556840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.556840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.557104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.557184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.557285] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be created. [ 707.589303] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.589626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.589626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.589781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.589946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.603099] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: UNINITIALIZED for 2s [ 708.068132] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c in Status: SUCCESS [ 708.068132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.669065] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 708.669065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.669065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.669065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.669065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.669441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.669482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.669740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.669843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.669956] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.173128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.173529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.173529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.173878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.173878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.173878] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.174097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.174097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.174224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.174299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.174357] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be updated. [ 709.197546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.197706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.197804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.198052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.198203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.206997] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: IN_PROGRESS for 2s [ 709.208961] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-5f5fcd38-db40-4f2e-8a3b-d7720805d463 tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 709.209807] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 709.210271] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.210417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.607713] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.609878] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.609878] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.609878] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.609878] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.609878] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.609878] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.609878] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.610331] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.610559] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.611080] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.611080] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.611080] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.611080] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.611242] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.611276] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.617422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 709.618134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.618134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.618385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.618606] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.618720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.618783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.618944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.619036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.619396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.619559] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.620365] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.620572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.620759] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.620978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.620978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.621286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.621286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.621379] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.629833] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.630384] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.630548] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.630726] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.631031] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.631212] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.631368] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.631667] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.632015] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c8e8b9d-3ec6-4814-973e-ce1de86a44cd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.752119] env[69219]: INFO networking_nsxv3.common.synchronization [req-811bfebc-a800-472f-8c45-2796bab4aa8f req-bb8683f1-9c4a-45c9-b080-183bb8e96a32 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 709.752709] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 709.753063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.753200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.753274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.753502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.753669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.753770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.753839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.754047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.754187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.754251] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.123072] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.123285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.125741] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.135505] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.135505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.135505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.135713] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.135713] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.135880] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9c8e8b9d-3ec6-4814-973e-ce1de86a44cd not found, creating... [ 710.136213] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.136347] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.136410] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.136626] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.136762] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.137047] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.137206] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.137322] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.137527] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.137661] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.137799] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9c8e8b9d-3ec6-4814-973e-ce1de86a44cd is going to be created. [ 710.157876] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.158087] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.158216] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.158503] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.158734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.158954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.256876] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.257227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.257227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.257356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.257444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.257649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.257764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.257821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.257980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.258075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.258165] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 710.295134] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.295312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.295381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.295543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.295779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.303840] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 710.627702] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.908740] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-8939d836-8a11-4099-9a19-976d3f6e0304 service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 710.908740] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-8939d836-8a11-4099-9a19-976d3f6e0304 service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 710.908740] env[69219]: INFO networking_nsxv3.common.synchronization [req-7e042cdd-0b85-4bd3-b818-927041af1cef req-8939d836-8a11-4099-9a19-976d3f6e0304 service nova] Enqueued Resource ID: 9c8e8b9d-3ec6-4814-973e-ce1de86a44cd with Priority: HIGHEST for action port [ 710.909276] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 710.909589] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 710.909589] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c8e8b9d-3ec6-4814-973e-ce1de86a44cd with Priority: HIGHEST for action port [ 710.913012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.913012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.913012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.913012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.913012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.913012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.913012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.913012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.913012] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c8e8b9d-3ec6-4814-973e-ce1de86a44cd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.130913] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.130913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.130913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.130913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.131303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.131303] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 711.158105] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.158263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.158367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.158533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.158786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.169558] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 711.216670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d in Status: SUCCESS [ 711.216975] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d deletion is rescheduled due to dependency. [ 711.217158] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.414170] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c8e8b9d-3ec6-4814-973e-ce1de86a44cd with status ACTIVE [ 711.414510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.414640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.414702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.414930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.415064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.415215] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.415310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.415369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.415528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.415599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.415781] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.415866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.415927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.416079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.416153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.416235] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c8e8b9d-3ec6-4814-973e-ce1de86a44cd is going to be updated. [ 711.447518] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.447762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.447762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.447962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.448118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.448282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c8e8b9d-3ec6-4814-973e-ce1de86a44cd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.851387] env[69219]: INFO networking_nsxv3.common.synchronization [req-81d1097d-9e99-41b3-b090-fd8441af83ec req-4d0160c4-5b2f-4cd9-93ec-f6d6a81c3ec3 tempest-TenantUsagesTestJSON-1976364789 tempest-TenantUsagesTestJSON-1976364789-project-member] Enqueued Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_members [ 711.851901] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGHEST for action security_group_members [ 711.852211] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.852329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.852401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.852597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.854023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.854023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.854023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.854023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.854023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.854023] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.916563] env[69219]: INFO networking_nsxv3.common.synchronization [req-89a9ba2e-c4aa-4d18-84bf-beaa5b37c46e req-21191e75-dde2-49b5-91eb-03cd5d1f0df1 tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 711.917059] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 711.917678] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.917678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.917678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.917858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.917858] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.917968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.918041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.918193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.918280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.918436] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.312582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 712.312779] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 712.312901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.355496] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.355694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.355802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.356072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.356221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.356463] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.356596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.356669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.356826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.356905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.356991] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c is going to be updated. [ 712.392266] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.392402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.392486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.392718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.392859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.400676] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c in Status: IN_PROGRESS for 2s [ 712.420191] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.420497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.420497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.420497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.420628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.420765] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.420869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.420934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.421101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.421178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.421264] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 712.443293] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.443450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.443498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.443663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.443794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.452472] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 713.180400] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 713.180400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.180400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.180400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.180823] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.180823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.180823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.181119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.181119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.181119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.182079] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.182079] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.182079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.182611] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.184038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.184038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.184038] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.184038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.184038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.184038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.184038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.184038] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.686807] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e223c622-11b3-472e-bc32-fa212373c375: rpc.has_security_group_logging(os_id): False [ 713.687587] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.708317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.708317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.708317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.708317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.709122] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.709122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.709122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.709122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.709122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.709122] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be created. [ 713.765232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.765414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.765491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.765707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.765965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.775487] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 714.191585] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.410825] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c in Status: SUCCESS [ 714.410825] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c deletion is rescheduled due to dependency. [ 714.410825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.465036] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 714.465160] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d deletion is rescheduled due to dependency. [ 714.465236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.693757] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.694177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.694177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.694266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.694301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.694483] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 714.725321] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.725523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.725592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.725776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.725921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.736853] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 715.732813] env[69219]: INFO networking_nsxv3.common.synchronization [req-d43e2e96-3cce-4db9-bd9d-e5b11a4bc307 req-b1fba243-f46e-43a9-a3e6-145db869e00a tempest-ServerExternalEventsTest-947707674 tempest-ServerExternalEventsTest-947707674-project-member] Enqueued Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_members [ 715.733391] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_members [ 715.733770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.733885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.733946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.734391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.734391] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.734815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.734815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.734815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.734815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.734815] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.787923] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 715.788185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.788337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.788597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.788689] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.197331] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.197548] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.197670] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.198312] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.198609] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.198780] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.198901] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.199153] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.199314] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.200029] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.200029] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.200029] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.200029] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.200029] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.200331] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.200331] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.218612] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.218787] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 716.218947] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.219150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.219472] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-8d98858e-2462-40a2-9267-c7e9d4ab11f5 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.219663] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.219785] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.220121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.220269] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d98858e-2462-40a2-9267-c7e9d4ab11f5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.240800] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.240800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.240940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.241104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.241199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.241399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.241497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.241557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.241703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.241780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.241872] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 already deleted. [ 716.241948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.296033] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.296033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.722829] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.723055] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.723184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.723472] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.723618] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.723864] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 8d98858e-2462-40a2-9267-c7e9d4ab11f5 not found, creating... [ 716.724659] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.724659] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.724659] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.724659] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.725036] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.725036] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.727084] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.727084] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.727084] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.727084] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.727084] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 8d98858e-2462-40a2-9267-c7e9d4ab11f5 is going to be created. [ 716.748120] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 716.748591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.748591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.749087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.749087] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.749231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.749231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.749671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.749671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.749671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.749873] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.751643] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.751849] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.751973] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.752229] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.752451] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.752670] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.254553] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.254723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.254799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.255034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.255207] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.255310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.255370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.256424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.256510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.256551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.257347] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.257347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.257347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.257347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.257347] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.257347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.257702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.257702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.257702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.257812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.257884] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.444153] env[69219]: INFO networking_nsxv3.common.synchronization [req-d43e2e96-3cce-4db9-bd9d-e5b11a4bc307 req-34954797-ce6e-42f6-8e36-0b973963261d service nova] Enqueued Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_rules [ 717.444956] env[69219]: INFO networking_nsxv3.common.synchronization [req-d43e2e96-3cce-4db9-bd9d-e5b11a4bc307 req-34954797-ce6e-42f6-8e36-0b973963261d service nova] Enqueued Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_members [ 717.445530] env[69219]: INFO networking_nsxv3.common.synchronization [req-d43e2e96-3cce-4db9-bd9d-e5b11a4bc307 req-34954797-ce6e-42f6-8e36-0b973963261d service nova] Enqueued Resource ID: 8d98858e-2462-40a2-9267-c7e9d4ab11f5 with Priority: HIGHEST for action port [ 717.446971] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_rules [ 717.447117] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_members [ 717.447203] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d98858e-2462-40a2-9267-c7e9d4ab11f5 with Priority: HIGHEST for action port [ 717.447501] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.447666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.447777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.448076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.448193] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.449071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.449221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.449331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.449579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.449814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.449926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.450061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.450597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.450597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.450597] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.452075] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d98858e-2462-40a2-9267-c7e9d4ab11f5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.453148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.453148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.453148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.453318] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d98858e-2462-40a2-9267-c7e9d4ab11f5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.759809] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e223c622-11b3-472e-bc32-fa212373c375: rpc.has_security_group_logging(os_id): False [ 717.777738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.777915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.777979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.778160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.778274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.778495] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.778619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.778878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.778878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.779035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.779106] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.779204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.779263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.779415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.779593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.779689] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.779787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.779845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.779985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.780078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.780216] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 717.833321] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.833321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.833321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.833321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.833321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.843421] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 717.956357] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.957446] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.957578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.957749] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d98858e-2462-40a2-9267-c7e9d4ab11f5 with status ACTIVE [ 717.957938] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.958092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.958150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.958379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.959128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.959128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.959128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.959128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.959128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.959441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.960420] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.960420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.960420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.960420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.960420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.960420] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d98858e-2462-40a2-9267-c7e9d4ab11f5 is going to be updated. [ 717.982417] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.982417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.982417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.982417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.982417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.982417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d98858e-2462-40a2-9267-c7e9d4ab11f5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.462746] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.969029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.969029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.969029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.969432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.969432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.969432] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 is going to be created. [ 718.991259] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.991415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.991472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.992072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.992337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.003212] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 in Status: UNINITIALIZED for 2s [ 719.855180] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 719.855467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.897272] env[69219]: INFO networking_nsxv3.common.synchronization [req-63335449-3810-485a-81fb-8a6a16dac829 req-004f54d9-78eb-4f8c-b92c-d317f7e12c0a tempest-ServersTestJSON-212915453 tempest-ServersTestJSON-212915453-project-member] Enqueued Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_members [ 720.897272] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGHEST for action security_group_members [ 720.897272] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.897272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.897272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.897272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.901024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.901024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.901024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.901024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.901024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.901024] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.013953] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 in Status: SUCCESS [ 721.014847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.015156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.015751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.015751] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.015751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.015966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.016100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.016183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.016270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.016380] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.405029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.405264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.405345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.405666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.405774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.406030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.406158] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.406199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.406447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.406506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.406664] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 is going to be updated. [ 721.433551] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.433727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.433777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.434093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.434529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.442644] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 in Status: IN_PROGRESS for 2s [ 721.520537] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.520537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.521200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.521200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.521200] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.521573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.521573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.521573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.521573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.521959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.521959] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.521959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.522194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.522194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.522364] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.523052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.523052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.523052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.523052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.523052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.523052] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.027258] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4400f28d-3242-47d4-b41d-7b3cbf9bbb75: rpc.has_security_group_logging(os_id): False [ 722.046229] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.046406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.047042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.047042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.047042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.047042] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.047243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.047243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.047321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.048120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.048120] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.048120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.048120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.048120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.048120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.048901] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.049010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.049094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.049306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.050443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.050443] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 is going to be created. [ 722.105125] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.105125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.105125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.105125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.105125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.135244] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 in Status: IN_PROGRESS for 2s [ 722.271157] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f067ecc7-5e0a-43bf-8fa5-4eed46126f24 None None] Enqueued Resource ID: 2f0d276b-3968-4757-a759-9958e30b844f with Priority: HIGHEST for action port [ 722.271157] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0d276b-3968-4757-a759-9958e30b844f with Priority: HIGHEST for action port [ 722.271157] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f0d276b-3968-4757-a759-9958e30b844f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.271157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f0d276b-3968-4757-a759-9958e30b844f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.271157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f0d276b-3968-4757-a759-9958e30b844f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.271157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f0d276b-3968-4757-a759-9958e30b844f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.271157] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f0d276b-3968-4757-a759-9958e30b844f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.777275] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f0d276b-3968-4757-a759-9958e30b844f [ 722.777512] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.777603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.777646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.780220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.780220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.780220] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f0d276b-3968-4757-a759-9958e30b844f already deleted. [ 722.780220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f0d276b-3968-4757-a759-9958e30b844f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.007086] env[69219]: INFO networking_nsxv3.common.synchronization [req-85a88129-9dc4-44d9-8bf0-e84f82404b6e req-95197392-8227-4b74-8391-82b2bd9fd927 tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 723.008387] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 723.008901] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.009205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.009387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.009731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.009999] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.011590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.011590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.011590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.011590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.011590] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.286356] env[69219]: INFO networking_nsxv3.common.synchronization [req-83078005-d85d-4df8-b0be-1142569f1155 req-081c0d6a-3a49-4df0-91e2-73cc6f7fa155 tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 723.288360] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 723.288360] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.288360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.453914] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 in Status: SUCCESS [ 723.453914] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 deletion is rescheduled due to dependency. [ 723.453914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.514604] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.019216] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.152206] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 in Status: SUCCESS [ 724.152206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.475638] env[69219]: INFO networking_nsxv3.common.synchronization [None req-53f15a4d-c4c9-43c8-95b7-3d325814ea8a None None] Enqueued Resource ID: 6e82a408-87f5-49b4-b051-845131979cee with Priority: HIGHEST for action port [ 724.475931] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e82a408-87f5-49b4-b051-845131979cee with Priority: HIGHEST for action port [ 724.478239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e82a408-87f5-49b4-b051-845131979cee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.478379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e82a408-87f5-49b4-b051-845131979cee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.478464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e82a408-87f5-49b4-b051-845131979cee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.479475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e82a408-87f5-49b4-b051-845131979cee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.479571] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e82a408-87f5-49b4-b051-845131979cee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.516491] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c2707b03-fcbc-4217-bf90-62067e7e5f18 None None] Enqueued Resource ID: d728ec0e-5ea1-4ea3-8a40-ad4d67279154 with Priority: HIGHEST for action port [ 724.517210] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d728ec0e-5ea1-4ea3-8a40-ad4d67279154 with Priority: HIGHEST for action port [ 724.517634] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d728ec0e-5ea1-4ea3-8a40-ad4d67279154 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.518231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d728ec0e-5ea1-4ea3-8a40-ad4d67279154" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.518231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d728ec0e-5ea1-4ea3-8a40-ad4d67279154" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.518825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d728ec0e-5ea1-4ea3-8a40-ad4d67279154" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.519251] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d728ec0e-5ea1-4ea3-8a40-ad4d67279154',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.522465] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.522644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.522695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.522871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.523291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.523291] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 724.549716] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.549879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.549971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.550408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.550570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.562144] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 724.982694] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e82a408-87f5-49b4-b051-845131979cee [ 724.983121] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.983263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.983330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.983543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.983644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.983735] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e82a408-87f5-49b4-b051-845131979cee already deleted. [ 724.983815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e82a408-87f5-49b4-b051-845131979cee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.022174] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d728ec0e-5ea1-4ea3-8a40-ad4d67279154 [ 725.024439] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.024568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.024638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.024861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.024954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.025060] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d728ec0e-5ea1-4ea3-8a40-ad4d67279154 already deleted. [ 725.025140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d728ec0e-5ea1-4ea3-8a40-ad4d67279154" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.588622] env[69219]: INFO networking_nsxv3.common.synchronization [req-1e37d228-6302-4360-aabd-948f0d4c4d73 req-5e832c33-aa7d-4449-b534-0f539b4a71f2 tempest-SecurityGroupRulesNegativeTestJSON-1302358541 tempest-SecurityGroupRulesNegativeTestJSON-1302358541-project-member] Enqueued Resource ID: cc945ea2-90d2-4463-8460-7a7bdc43b670 with Priority: HIGHEST for action security_group_rules [ 725.589747] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc945ea2-90d2-4463-8460-7a7bdc43b670 with Priority: HIGHEST for action security_group_rules [ 725.591099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc945ea2-90d2-4463-8460-7a7bdc43b670 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.591099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.591191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.591390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.591488] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc945ea2-90d2-4463-8460-7a7bdc43b670',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.889337] env[69219]: INFO networking_nsxv3.common.synchronization [req-298d44e7-8f2c-4318-97c6-1b525294ed04 req-e072d470-ae3a-4afa-a6b8-a354e2ce7e94 tempest-SecurityGroupRulesNegativeTestJSON-1302358541 tempest-SecurityGroupRulesNegativeTestJSON-1302358541-project-member] Enqueued Resource ID: cc945ea2-90d2-4463-8460-7a7bdc43b670 with Priority: HIGHEST for action security_group_rules [ 725.889838] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc945ea2-90d2-4463-8460-7a7bdc43b670 with Priority: HIGHEST for action security_group_rules [ 725.890505] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc945ea2-90d2-4463-8460-7a7bdc43b670 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.890621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.115166] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.115312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.115386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.115611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.116119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.116119] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc945ea2-90d2-4463-8460-7a7bdc43b670 already deleted. [ 726.116119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.116119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.116243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.116269] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc945ea2-90d2-4463-8460-7a7bdc43b670',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.258903] env[69219]: INFO networking_nsxv3.common.synchronization [req-9151518f-d215-490f-a31a-5f201d0c97b2 req-7abbeb37-1606-4c08-8c24-a13a0b584e1d tempest-ServersAdminNegativeTestJSON-713106145 tempest-ServersAdminNegativeTestJSON-713106145-project-member] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 726.261457] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 726.261457] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.261457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.261457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.261457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.261457] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.261457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.261457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.261457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.261457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.261457] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.572625] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 726.572858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.573034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.573253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.573444] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.573573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.573638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.574186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.574395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.574549] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.618018] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.618018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.618018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.618018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.618018] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.618434] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.618518] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.618815] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.618995] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.619425] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.619575] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.619707] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.619816] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.619949] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.620101] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.620276] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.645498] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.645498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.645498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.645498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.645670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.645670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc945ea2-90d2-4463-8460-7a7bdc43b670 already deleted. [ 726.645729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc945ea2-90d2-4463-8460-7a7bdc43b670" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.646617] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.646765] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.647058] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.647116] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.647362] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-3cd3f2be-595d-4e3d-8137-2d193c6248ba taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.647524] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.647663] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.647952] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.648503] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd3f2be-595d-4e3d-8137-2d193c6248ba',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.764139] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.078016] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.078016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.078016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.079016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.079016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.079016] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.079016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.079016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.079920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.082198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.082198] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 727.107634] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.107634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.107634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.107634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.107634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.115944] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 727.150520] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.154024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 3cd3f2be-595d-4e3d-8137-2d193c6248ba not found, creating... [ 727.154024] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.154024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.154404] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.154404] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.154404] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.154404] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.154404] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.154404] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 3cd3f2be-595d-4e3d-8137-2d193c6248ba is going to be created. [ 727.173623] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.175372] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.175520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.175820] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.176062] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.176299] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.239243] env[69219]: INFO networking_nsxv3.common.synchronization [None req-0f0eff9f-b872-416a-b35b-f8713388af68 None None] Enqueued Resource ID: 4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424 with Priority: HIGHEST for action port [ 727.240117] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424 with Priority: HIGHEST for action port [ 727.241030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.242390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.242390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.242563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.242676] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.268524] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.746482] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424 [ 727.747596] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.747851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.747851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.748274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.748545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.748689] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424 already deleted. [ 727.748789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4069c1ed-f2ae-4ecf-84b2-cef0ec0d8424" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.773056] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.775772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.775772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.775772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.775772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.775772] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be updated. [ 727.804030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.804030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.804030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.804228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.804376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.817383] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: IN_PROGRESS for 2s [ 728.054987] env[69219]: INFO networking_nsxv3.common.synchronization [req-9151518f-d215-490f-a31a-5f201d0c97b2 req-5eab1020-3b0a-43bf-a9df-9938969e8979 service nova] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_rules [ 728.055189] env[69219]: INFO networking_nsxv3.common.synchronization [req-9151518f-d215-490f-a31a-5f201d0c97b2 req-5eab1020-3b0a-43bf-a9df-9938969e8979 service nova] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 728.055326] env[69219]: INFO networking_nsxv3.common.synchronization [req-9151518f-d215-490f-a31a-5f201d0c97b2 req-5eab1020-3b0a-43bf-a9df-9938969e8979 service nova] Enqueued Resource ID: 3cd3f2be-595d-4e3d-8137-2d193c6248ba with Priority: HIGHEST for action port [ 728.055553] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_rules [ 728.055676] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 728.055772] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cd3f2be-595d-4e3d-8137-2d193c6248ba with Priority: HIGHEST for action port [ 728.059279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.059474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.059596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.059815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.059899] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.060755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.060854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.061058] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cd3f2be-595d-4e3d-8137-2d193c6248ba taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.061164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.061220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.061383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.061457] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cd3f2be-595d-4e3d-8137-2d193c6248ba',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.423772] env[69219]: INFO networking_nsxv3.common.synchronization [None req-ddbac2ba-71e0-4623-97a6-169e49b18fae None None] Enqueued Resource ID: df0d59d9-9b68-4e0c-addc-b41961a65407 with Priority: HIGHEST for action port [ 728.424040] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0d59d9-9b68-4e0c-addc-b41961a65407 with Priority: HIGHEST for action port [ 728.424610] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0d59d9-9b68-4e0c-addc-b41961a65407 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.424773] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0d59d9-9b68-4e0c-addc-b41961a65407" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.424807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0d59d9-9b68-4e0c-addc-b41961a65407" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.429099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0d59d9-9b68-4e0c-addc-b41961a65407" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.429218] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0d59d9-9b68-4e0c-addc-b41961a65407',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.563402] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.564676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.564676] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cd3f2be-595d-4e3d-8137-2d193c6248ba with status ACTIVE [ 728.564676] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.564676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.564676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.564884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.564916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.565131] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.565233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.565295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.565462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.565566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.565772] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.565877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.565929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.566084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.566164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.566237] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cd3f2be-595d-4e3d-8137-2d193c6248ba is going to be updated. [ 728.598788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.598936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.598999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.599235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.599376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.599574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cd3f2be-595d-4e3d-8137-2d193c6248ba" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.933530] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df0d59d9-9b68-4e0c-addc-b41961a65407 [ 728.933807] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.933906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.933977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.934248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.934348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.934451] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df0d59d9-9b68-4e0c-addc-b41961a65407 already deleted. [ 728.934534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0d59d9-9b68-4e0c-addc-b41961a65407" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.065759] env[69219]: INFO networking_nsxv3.common.synchronization [req-04d3e87e-fef0-4045-b649-13b144b70522 req-dfc78676-69ab-4c77-ab90-55e320fef861 tempest-ServerExternalEventsTest-947707674 tempest-ServerExternalEventsTest-947707674-project-member] Enqueued Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_members [ 729.066303] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGHEST for action security_group_members [ 729.066868] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.066868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.066868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.067013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.069202] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.069494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.069494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.069590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.069658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.069789] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.126242] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 729.126654] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 deletion is rescheduled due to dependency. [ 729.126654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.196859] env[69219]: INFO networking_nsxv3.common.synchronization [req-33026ec0-0f69-4919-95ea-a4bf3c96b576 req-8e0da201-4a4d-4fcc-8a69-2f185cde9121 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_members [ 729.196859] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_members [ 729.196859] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.196859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.196859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.196859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.197405] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.197638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.197825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.198195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.198353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.198541] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.380951] env[69219]: INFO networking_nsxv3.common.synchronization [req-54deb964-d5dc-4b09-9674-4f15ec06a83c req-317cd4b3-46bd-4e6e-bdc1-afb7e547b036 tempest-SecurityGroupRulesTestJSON-471973336 tempest-SecurityGroupRulesTestJSON-471973336-project-member] Enqueued Resource ID: 5c1e0821-eb45-4532-b26b-282cb3e3f41a with Priority: HIGHEST for action security_group_rules [ 729.380951] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1e0821-eb45-4532-b26b-282cb3e3f41a with Priority: HIGHEST for action security_group_rules [ 729.380951] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c1e0821-eb45-4532-b26b-282cb3e3f41a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.380951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c1e0821-eb45-4532-b26b-282cb3e3f41a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.380951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c1e0821-eb45-4532-b26b-282cb3e3f41a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.382968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c1e0821-eb45-4532-b26b-282cb3e3f41a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.383114] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c1e0821-eb45-4532-b26b-282cb3e3f41a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.563562] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.563798] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.564268] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.564268] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.564945] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.565198] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.565463] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.565603] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.565925] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.566243] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.566521] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.566711] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.566831] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.567522] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.567522] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.567522] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.571353] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.571464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.571532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.571734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.571820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.572013] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.572114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.572180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.572312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.572385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.572464] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 is going to be updated. [ 729.589847] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.590066] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.590182] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.590360] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.590832] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-4291446f-fafc-495e-805f-4c346d58f9c3 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.591494] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.591494] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.591642] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.591642] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4291446f-fafc-495e-805f-4c346d58f9c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.630097] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.630097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.630200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.630374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.630507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.639335] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 in Status: IN_PROGRESS for 2s [ 729.701858] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.702031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.702107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.702320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.702414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.702620] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.702724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.702786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.702977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.703065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.703154] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c already deleted. [ 729.703233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.829754] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: SUCCESS [ 729.829754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.829754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.829754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.829754] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.829754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.829754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.829754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.829754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.829754] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.905576] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.905576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.905576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.905576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.905576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.905576] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c1e0821-eb45-4532-b26b-282cb3e3f41a already deleted. [ 729.905576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c1e0821-eb45-4532-b26b-282cb3e3f41a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.094128] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.094416] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.094477] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.094782] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.094934] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.095100] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 4291446f-fafc-495e-805f-4c346d58f9c3 not found, creating... [ 730.095367] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.095529] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.095648] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.096191] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.096191] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.096320] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.096641] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.096641] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.096836] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.096928] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.097110] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 4291446f-fafc-495e-805f-4c346d58f9c3 is going to be created. [ 730.125160] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.125160] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.125160] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.125160] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.125160] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.125160] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.332084] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.380895] env[69219]: INFO networking_nsxv3.common.synchronization [req-c0c7f60f-97e2-490f-a3b5-11adf011647c req-5ae118b6-b338-498c-adbd-6bbf8d0e70cc tempest-SecurityGroupRulesTestJSON-471973336 tempest-SecurityGroupRulesTestJSON-471973336-project-member] Enqueued Resource ID: 00e7fc81-b474-4413-ae4b-97718c5b371b with Priority: HIGHEST for action security_group_rules [ 730.380895] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e7fc81-b474-4413-ae4b-97718c5b371b with Priority: HIGHEST for action security_group_rules [ 730.380895] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e7fc81-b474-4413-ae4b-97718c5b371b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.380895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e7fc81-b474-4413-ae4b-97718c5b371b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.380895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e7fc81-b474-4413-ae4b-97718c5b371b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.380895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e7fc81-b474-4413-ae4b-97718c5b371b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.383479] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e7fc81-b474-4413-ae4b-97718c5b371b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.682571] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2f0b7c4c-5449-4dc4-aaf6-dc9b20304d9c None None] Enqueued Resource ID: 8a9df1cd-1f02-4b54-ba86-3d2192e2578a with Priority: HIGHEST for action port [ 730.683267] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9df1cd-1f02-4b54-ba86-3d2192e2578a with Priority: HIGHEST for action port [ 730.685250] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a9df1cd-1f02-4b54-ba86-3d2192e2578a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.685415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a9df1cd-1f02-4b54-ba86-3d2192e2578a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.685499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a9df1cd-1f02-4b54-ba86-3d2192e2578a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.685750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a9df1cd-1f02-4b54-ba86-3d2192e2578a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.685833] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a9df1cd-1f02-4b54-ba86-3d2192e2578a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.836494] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.888485] env[69219]: INFO networking_nsxv3.common.synchronization [req-33026ec0-0f69-4919-95ea-a4bf3c96b576 req-9434b967-5d12-43ba-96b5-d78ed041804d service nova] Enqueued Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_rules [ 730.891302] env[69219]: INFO networking_nsxv3.common.synchronization [req-33026ec0-0f69-4919-95ea-a4bf3c96b576 req-9434b967-5d12-43ba-96b5-d78ed041804d service nova] Enqueued Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_members [ 730.891302] env[69219]: INFO networking_nsxv3.common.synchronization [req-33026ec0-0f69-4919-95ea-a4bf3c96b576 req-9434b967-5d12-43ba-96b5-d78ed041804d service nova] Enqueued Resource ID: 4291446f-fafc-495e-805f-4c346d58f9c3 with Priority: HIGHEST for action port [ 730.891302] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_rules [ 730.891302] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_members [ 730.891302] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4291446f-fafc-495e-805f-4c346d58f9c3 with Priority: HIGHEST for action port [ 730.893050] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.893459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.893565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.893970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.894122] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.895543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.895888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.895983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.896212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.896416] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.896543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.896605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.896797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.897447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.897572] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.901096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-4291446f-fafc-495e-805f-4c346d58f9c3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.901196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.901233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.901379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.903925] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4291446f-fafc-495e-805f-4c346d58f9c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.905222] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.905473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.906187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.906187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.906187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.906187] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e7fc81-b474-4413-ae4b-97718c5b371b already deleted. [ 730.906187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e7fc81-b474-4413-ae4b-97718c5b371b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.189992] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a9df1cd-1f02-4b54-ba86-3d2192e2578a [ 731.190315] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.190437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.190510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.190731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.190829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.190924] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a9df1cd-1f02-4b54-ba86-3d2192e2578a already deleted. [ 731.191018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a9df1cd-1f02-4b54-ba86-3d2192e2578a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.340396] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.340396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.340396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.340396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.340396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.340396] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be updated. [ 731.363877] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.364030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.364104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.367251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.367251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.377699] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: IN_PROGRESS for 2s [ 731.378134] env[69219]: INFO networking_nsxv3.common.synchronization [req-06721f6f-b283-4019-b117-bf51f0ccba82 req-3eb647b0-ce9c-40fb-8482-c3a204248396 tempest-SecurityGroupRulesTestJSON-471973336 tempest-SecurityGroupRulesTestJSON-471973336-project-member] Enqueued Resource ID: 4f3db2a1-3602-4e4c-8280-a09f12d0c79a with Priority: HIGHEST for action security_group_rules [ 731.378375] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3db2a1-3602-4e4c-8280-a09f12d0c79a with Priority: HIGHEST for action security_group_rules [ 731.378935] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f3db2a1-3602-4e4c-8280-a09f12d0c79a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.379065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f3db2a1-3602-4e4c-8280-a09f12d0c79a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.379131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f3db2a1-3602-4e4c-8280-a09f12d0c79a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.379371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f3db2a1-3602-4e4c-8280-a09f12d0c79a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.379448] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f3db2a1-3602-4e4c-8280-a09f12d0c79a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.405093] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.405093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.405197] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.405964] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4291446f-fafc-495e-805f-4c346d58f9c3 with status ACTIVE [ 731.406148] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.407451] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.407451] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.407451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.407998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.407998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.407998] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4291446f-fafc-495e-805f-4c346d58f9c3 is going to be updated. [ 731.427806] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.427937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.428017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.428236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.428433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.428620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4291446f-fafc-495e-805f-4c346d58f9c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.649771] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 in Status: SUCCESS [ 731.650098] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 deletion is rescheduled due to dependency. [ 731.650228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.789811] env[69219]: INFO networking_nsxv3.common.synchronization [req-c0f3411b-7212-4f9d-9f43-cfc4a6fa9f5e req-4003af0b-b294-4863-a9cc-254ba7f6a0e5 tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 731.790312] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 731.790697] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.790875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.790954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.791637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.791814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.791919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.791982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.792170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.792249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.792349] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.905674] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.905831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.905901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.906150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.906247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.906578] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f3db2a1-3602-4e4c-8280-a09f12d0c79a already deleted. [ 731.906578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f3db2a1-3602-4e4c-8280-a09f12d0c79a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.909904] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.214931] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.215224] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.215301] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.216195] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.216467] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.216639] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.216763] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.219505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.219505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.219505] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.219505] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.219505] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.219505] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.219505] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.219505] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.219818] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.237474] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.237640] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.237783] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.237972] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.238364] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c975cd8a-a8bb-4f65-8651-0a10e691cd10 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.238865] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.239065] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.239425] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.239639] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c975cd8a-a8bb-4f65-8651-0a10e691cd10',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.294271] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.294434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.294509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.294736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.294834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.295064] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.295180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.295245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.295402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.295483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.295566] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe already deleted. [ 732.295650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.412513] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.412692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.412779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.413053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.413167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.413287] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c is going to be created. [ 732.436925] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.437341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.437444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.437666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.437835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.451141] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c in Status: UNINITIALIZED for 2s [ 732.554704] env[69219]: INFO networking_nsxv3.common.synchronization [req-e06624aa-c68d-4100-a890-d261d9c454c1 req-e11626ec-db1c-41cf-84cf-e4de351d918a tempest-SecurityGroupRulesTestJSON-471973336 tempest-SecurityGroupRulesTestJSON-471973336-project-member] Enqueued Resource ID: c7a6190f-db00-4d1b-bb71-2c8c5ec55a95 with Priority: HIGHEST for action security_group_rules [ 732.555258] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7a6190f-db00-4d1b-bb71-2c8c5ec55a95 with Priority: HIGHEST for action security_group_rules [ 732.555555] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7a6190f-db00-4d1b-bb71-2c8c5ec55a95 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.555699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7a6190f-db00-4d1b-bb71-2c8c5ec55a95" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.555770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7a6190f-db00-4d1b-bb71-2c8c5ec55a95" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.557440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7a6190f-db00-4d1b-bb71-2c8c5ec55a95" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.557565] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7a6190f-db00-4d1b-bb71-2c8c5ec55a95',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.742528] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.742813] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.742953] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.743923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.743923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.743923] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c975cd8a-a8bb-4f65-8651-0a10e691cd10 not found, creating... [ 732.743923] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.744252] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.744252] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.744334] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.744446] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.744739] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.744897] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.745528] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.745528] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.745641] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.745778] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 is going to be created. [ 732.766383] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.766602] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.766730] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.767009] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.767241] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.767464] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.082879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.082879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.082879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.082879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.082879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.082879] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7a6190f-db00-4d1b-bb71-2c8c5ec55a95 already deleted. [ 733.082879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7a6190f-db00-4d1b-bb71-2c8c5ec55a95" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.400144] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: SUCCESS [ 733.400144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.400144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.400748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.401960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.403018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.403018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.403018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.403018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.403018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.403348] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.472796] env[69219]: INFO networking_nsxv3.common.synchronization [req-c0f3411b-7212-4f9d-9f43-cfc4a6fa9f5e req-96425895-568c-475c-830c-f4a929ec3c9c service nova] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 733.472796] env[69219]: INFO networking_nsxv3.common.synchronization [req-c0f3411b-7212-4f9d-9f43-cfc4a6fa9f5e req-96425895-568c-475c-830c-f4a929ec3c9c service nova] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 733.472796] env[69219]: INFO networking_nsxv3.common.synchronization [req-c0f3411b-7212-4f9d-9f43-cfc4a6fa9f5e req-96425895-568c-475c-830c-f4a929ec3c9c service nova] Enqueued Resource ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 with Priority: HIGHEST for action port [ 733.473126] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 733.473126] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 733.476292] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 with Priority: HIGHEST for action port [ 733.476292] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.476292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.476292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.476292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.476292] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.477417] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.477417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.477417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.477417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.477574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.477687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.477687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.477891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.477943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.477992] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.478831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c975cd8a-a8bb-4f65-8651-0a10e691cd10 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.478895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.478933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.479097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.480310] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c975cd8a-a8bb-4f65-8651-0a10e691cd10',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.539016] env[69219]: INFO networking_nsxv3.common.synchronization [None req-550b3739-6bd1-4a81-bf0c-b9cde4d4e69e None None] Enqueued Resource ID: 34458e9f-6da2-4030-8115-819c5f8a3173 with Priority: HIGHEST for action port [ 733.539016] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34458e9f-6da2-4030-8115-819c5f8a3173 with Priority: HIGHEST for action port [ 733.539016] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-34458e9f-6da2-4030-8115-819c5f8a3173 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.539016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34458e9f-6da2-4030-8115-819c5f8a3173" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.539016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34458e9f-6da2-4030-8115-819c5f8a3173" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.539957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34458e9f-6da2-4030-8115-819c5f8a3173" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.540205] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34458e9f-6da2-4030-8115-819c5f8a3173',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.906365] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.906556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.906643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.906889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.907099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.907214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.907279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.907434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.907524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.907618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.907762] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.907856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.907916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.908072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.908209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.908300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.908360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.908505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.908595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.908681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.908770] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.981295] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.981295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.981471] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.982978] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c975cd8a-a8bb-4f65-8651-0a10e691cd10 with status ACTIVE [ 733.987760] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.987760] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.987760] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.987760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.987760] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 is going to be updated. [ 734.008173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.011194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.011194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.011194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.011194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.011194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.045092] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34458e9f-6da2-4030-8115-819c5f8a3173 [ 734.045248] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.045407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.045551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.048599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.048599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.048599] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34458e9f-6da2-4030-8115-819c5f8a3173 already deleted. [ 734.048599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34458e9f-6da2-4030-8115-819c5f8a3173" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.412793] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f8662e1-7633-4a32-9aae-91c642b75dd8: rpc.has_security_group_logging(os_id): False [ 734.429288] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.429429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.429507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.429720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.429812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.430075] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.430162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.430194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.430343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.430418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.430593] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.430687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.430747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.430887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.430961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.431147] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.431239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.431298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.431438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.431533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.431587] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be updated. [ 734.459181] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c in Status: SUCCESS [ 734.459246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.459375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.459576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.459785] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.459919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.459968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.460111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.460190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.460399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.460399] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.484602] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.490664] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.490664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.490664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.490664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.490664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.505832] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: IN_PROGRESS for 2s [ 734.652562] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ced4a63-e83f-4e09-b09b-a68327571e6e req-cbaed69e-7383-4477-a701-b6ddfbae9d2b tempest-SecurityGroupRulesTestJSON-471973336 tempest-SecurityGroupRulesTestJSON-471973336-project-member] Enqueued Resource ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 with Priority: HIGHEST for action security_group_rules [ 734.653140] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 with Priority: HIGHEST for action security_group_rules [ 734.653449] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.653571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.653641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.653893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.654018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dabf8b6-79a4-46da-b524-e967ab1fe8c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.672404] env[69219]: INFO networking_nsxv3.common.synchronization [None req-e47896de-a14d-4c1e-9cfe-8d9cd8cc1649 tempest-ServerActionsV293TestJSON-1968701766 tempest-ServerActionsV293TestJSON-1968701766-project-member] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_rules [ 734.673248] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_rules [ 734.674547] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.674547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.674547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.674859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.674913] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.836484] env[69219]: INFO networking_nsxv3.common.synchronization [None req-524c7810-ec54-411f-abeb-4c2d620fc37c tempest-ServerActionsV293TestJSON-1968701766 tempest-ServerActionsV293TestJSON-1968701766-project-member] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_rules [ 734.837931] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_rules [ 734.839081] env[69219]: INFO networking_nsxv3.common.synchronization [req-2da1902e-1b03-4c64-b1df-1e93002cb6a1 req-ce45fd96-becd-4cd7-a4f6-2fc5f2f1858d tempest-SecurityGroupRulesTestJSON-471973336 tempest-SecurityGroupRulesTestJSON-471973336-project-member] Enqueued Resource ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 with Priority: HIGHEST for action security_group_rules [ 734.839291] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.839424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.839868] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 with Priority: HIGHEST for action security_group_rules [ 734.840158] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.841377] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.964360] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.987539] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.987729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.988096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.988096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.988096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.989054] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be created. [ 735.010768] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.010768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.010768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.010935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.012051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.023364] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: UNINITIALIZED for 2s [ 735.174678] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.174839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.174911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.175219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.175331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.175470] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 already deleted. [ 735.175575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.175779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.175975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.176081] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dabf8b6-79a4-46da-b524-e967ab1fe8c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.194748] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.194933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.195014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.195280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.195396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.195521] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 already deleted. [ 735.195653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.195855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.196073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.196354] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.452710] env[69219]: INFO networking_nsxv3.common.synchronization [req-a4970223-a3b5-4552-abf8-d8d0a3bc4472 req-4e7b2c6f-4419-4287-a4b7-b0e8090902de tempest-SecurityGroupRulesTestJSON-471973336 tempest-SecurityGroupRulesTestJSON-471973336-project-member] Enqueued Resource ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 with Priority: HIGHEST for action security_group_rules [ 735.452971] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 with Priority: HIGHEST for action security_group_rules [ 735.453336] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.453385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.471727] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c: rpc.has_security_group_logging(os_id): False [ 735.489788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.489926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.490021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.490259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.490352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.490651] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.491101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.491101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.491101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.491857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.491857] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c is going to be created. [ 735.549336] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.549473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.549547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.549843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.549939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.558522] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c in Status: IN_PROGRESS for 2s [ 735.698668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.698668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.698668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.698875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.699493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.699493] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 already deleted. [ 735.699493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.700251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.700454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.700604] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dabf8b6-79a4-46da-b524-e967ab1fe8c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.722285] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.722479] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.724862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.724862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.724862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.724862] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 already deleted. [ 735.724862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.786655] env[69219]: INFO networking_nsxv3.common.synchronization [None req-9616e1dc-da51-4c9d-b4f5-abf5f2bd5d8c None None] Enqueued Resource ID: 9de9843d-f322-4d88-a8b9-c675cab90065 with Priority: HIGHEST for action port [ 735.786655] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de9843d-f322-4d88-a8b9-c675cab90065 with Priority: HIGHEST for action port [ 735.786655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9de9843d-f322-4d88-a8b9-c675cab90065 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.786655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9de9843d-f322-4d88-a8b9-c675cab90065" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.786655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9de9843d-f322-4d88-a8b9-c675cab90065" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.786655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9de9843d-f322-4d88-a8b9-c675cab90065" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.786655] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de9843d-f322-4d88-a8b9-c675cab90065',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.223325] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.223522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.223642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.223898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.224054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.224210] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dabf8b6-79a4-46da-b524-e967ab1fe8c3 already deleted. [ 736.224330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dabf8b6-79a4-46da-b524-e967ab1fe8c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.292091] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9de9843d-f322-4d88-a8b9-c675cab90065 [ 736.292344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.292497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.292572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.293902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.293902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.293902] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9de9843d-f322-4d88-a8b9-c675cab90065 already deleted. [ 736.293902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9de9843d-f322-4d88-a8b9-c675cab90065" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.519233] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: SUCCESS [ 736.519464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.035875] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 737.036152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.036344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.036745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.037235] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.037235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.037353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.037540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.037662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.037790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.037927] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.142609] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c45ebe0-cacb-4086-becd-34bdc17b394c req-9e93481b-0a58-430c-882f-5020822ff21a tempest-VolumesAdminNegativeTest-292929570 tempest-VolumesAdminNegativeTest-292929570-project-member] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_members [ 737.143443] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_members [ 737.143796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.144513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.144646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.144934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.145134] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.145246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.145309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.145477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.145566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.145664] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.507039] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-789 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.507039] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.508193] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.508193] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.508193] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.508325] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.508387] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.508707] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.508869] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.509100] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.509228] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.509821] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.510047] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.510188] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 737.510311] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.510473] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.530259] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.530523] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 737.530607] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.531607] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.531607] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-cad064ad-6671-4379-8528-0929d34bf7ac taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.531607] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.531607] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.532107] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.532214] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cad064ad-6671-4379-8528-0929d34bf7ac',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.542527] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.570615] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c in Status: SUCCESS [ 737.570875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.652561] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.652675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.653469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.653735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.653835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.654070] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.654239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.654239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.654400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.654483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.654571] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 already deleted. [ 737.654671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.036832] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.036832] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.036999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.038029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.038029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.038029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port cad064ad-6671-4379-8528-0929d34bf7ac not found, creating... [ 738.038029] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.038392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.038392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.038511] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.038696] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.039043] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.039225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.039324] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.039557] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.039759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.039927] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: cad064ad-6671-4379-8528-0929d34bf7ac is going to be created. [ 738.045036] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec5e6bce-48d8-4a26-8add-53a08d2b2afe: rpc.has_security_group_logging(os_id): False [ 738.062609] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.062824] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.062949] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.063254] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.063480] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.063730] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.065146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.065255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.065320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.065497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.065981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.065981] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.065981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.065981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.066157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.066157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.066237] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be created. [ 738.149255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.149393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.149459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.149708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.149909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.166852] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 738.778033] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c45ebe0-cacb-4086-becd-34bdc17b394c req-ba240d29-7063-4f30-ab6d-c7ed2d6b18f4 service nova] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_rules [ 738.778345] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c45ebe0-cacb-4086-becd-34bdc17b394c req-ba240d29-7063-4f30-ab6d-c7ed2d6b18f4 service nova] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_members [ 738.778345] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c45ebe0-cacb-4086-becd-34bdc17b394c req-ba240d29-7063-4f30-ab6d-c7ed2d6b18f4 service nova] Enqueued Resource ID: cad064ad-6671-4379-8528-0929d34bf7ac with Priority: HIGHEST for action port [ 738.778607] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_rules [ 738.778716] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_members [ 738.778816] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cad064ad-6671-4379-8528-0929d34bf7ac with Priority: HIGHEST for action port [ 738.779376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.779536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.779740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.779770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.779846] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.783422] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.783561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.783632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.783806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.783959] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.784089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.784137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.784267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.784921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.784921] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.785183] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cad064ad-6671-4379-8528-0929d34bf7ac taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.785372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.785372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.785510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.785894] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cad064ad-6671-4379-8528-0929d34bf7ac',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.289535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.289535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.289535] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.291039] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cad064ad-6671-4379-8528-0929d34bf7ac with status ACTIVE [ 739.291039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.291039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.291039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.291039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.291229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.291283] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.291378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.291472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.291590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.291669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.291986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.291986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.294919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.294919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.294919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.295046] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cad064ad-6671-4379-8528-0929d34bf7ac is going to be updated. [ 739.314478] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.314609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.314681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.314882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.315145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.315299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cad064ad-6671-4379-8528-0929d34bf7ac" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.797352] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.094126] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ff696df-3a7c-412c-a1c5-306b853d230d req-9e05e1a0-34fc-46de-ab15-e9d58e019663 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 740.094747] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 740.095024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.096353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.096353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.096353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.096353] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.096353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.096353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.096602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.096703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.096765] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.179665] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 740.180009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.301456] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.301456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.301456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.301590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.301670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.301783] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 is going to be created. [ 740.345048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.345192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.345260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.345463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.345619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.363673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: UNINITIALIZED for 2s [ 740.601456] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.601615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.601722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.601969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.602078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.602299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.602408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.602488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.602687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.602744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.603430] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 740.626556] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.626816] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.627380] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.627668] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.627943] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.628785] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.628785] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.630965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.630965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.630965] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.630965] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.630965] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.630965] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.630965] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.630965] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.630965] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.658329] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.658500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.658597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.658831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.658980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.667848] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.668085] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.668174] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.668351] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.668902] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9f8f9649-8415-45e2-9923-b19f99309064 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.668902] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.669068] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.669426] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.669493] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f8f9649-8415-45e2-9923-b19f99309064',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.673639] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 741.173379] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.173719] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.173762] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.174024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.174193] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.174422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9f8f9649-8415-45e2-9923-b19f99309064 not found, creating... [ 741.174754] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.174921] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.175505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.175505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.175505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.175709] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.175866] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.175983] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.176204] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.176539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.176713] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9f8f9649-8415-45e2-9923-b19f99309064 is going to be created. [ 741.196749] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.196955] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.197105] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.197366] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.197588] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.197808] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.969496] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ff696df-3a7c-412c-a1c5-306b853d230d req-f79d346b-8dce-4501-9c82-4b631c78dbbc service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 741.969682] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ff696df-3a7c-412c-a1c5-306b853d230d req-f79d346b-8dce-4501-9c82-4b631c78dbbc service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 741.969813] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ff696df-3a7c-412c-a1c5-306b853d230d req-f79d346b-8dce-4501-9c82-4b631c78dbbc service nova] Enqueued Resource ID: 9f8f9649-8415-45e2-9923-b19f99309064 with Priority: HIGHEST for action port [ 741.970052] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 741.970178] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 741.970271] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f8f9649-8415-45e2-9923-b19f99309064 with Priority: HIGHEST for action port [ 741.970809] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.970939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.971071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.972523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.972618] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.973827] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.973922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.974119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f8f9649-8415-45e2-9923-b19f99309064 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.974218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.974278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.974457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.974521] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f8f9649-8415-45e2-9923-b19f99309064',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.373197] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: SUCCESS [ 742.373442] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.373587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.373828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.373996] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.374127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.374192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.375980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.376125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.376294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.376369] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.476284] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.476284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.476461] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f8f9649-8415-45e2-9923-b19f99309064 with status ACTIVE [ 742.476641] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.476761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.476832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.477135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.477236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.477416] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.477515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.477580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.477737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.477815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.477994] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.478103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.478166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.478302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.478379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.478464] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f8f9649-8415-45e2-9923-b19f99309064 is going to be updated. [ 742.498687] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.498872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.498969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.499242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.499434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.499908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f8f9649-8415-45e2-9923-b19f99309064" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.685952] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 742.686372] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 742.686640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.687048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.687998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.687998] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.687998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.687998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.687998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.687998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.688718] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.882383] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.191307] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.385589] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4dd29e2-bd83-4aa6-8057-859cad475a65: rpc.has_security_group_logging(os_id): False [ 743.429430] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.429430] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.429430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.429430] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 is going to be created. [ 743.568374] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.568511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.568609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.569277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.569277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.578732] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: IN_PROGRESS for 2s [ 743.694522] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.911892] env[69219]: INFO networking_nsxv3.common.synchronization [req-06c7e2de-d9ba-417f-919d-38e430ecdace req-f8bf3908-1421-4cac-95c1-3aaca7d58dd8 tempest-ServersAdminNegativeTestJSON-713106145 tempest-ServersAdminNegativeTestJSON-713106145-project-member] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 743.913276] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 743.913276] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.913276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.913276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.913276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.918399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.918610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.918698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.918935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.919048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.920593] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.200176] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.200874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.200874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.200874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.200874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.200874] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 744.232177] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.232177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.232177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.232177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.232177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.238343] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 744.425813] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.930583] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.436441] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.436441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.436441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.436441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.436441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.436441] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be updated. [ 745.462335] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.462801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.463033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.463375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.463680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.474716] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: IN_PROGRESS for 2s [ 745.595517] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: SUCCESS [ 745.595517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.248129] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 746.248183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.248913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.249094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.249755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.249755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.249755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.249755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.249755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.249986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.249986] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.753129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.753499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.753499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.753729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.753946] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.754125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.754230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.754362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.754462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.754580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.754838] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.755080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.755171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.755422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.755896] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.755896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.756040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.756412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.756529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.756617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.756728] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.260174] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03b383a8-62e8-454b-9d3c-ac3de2f9ba05: rpc.has_security_group_logging(os_id): False [ 747.279162] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.279763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.279763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.279763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.279763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.279931] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.280264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.280264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.280264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.280264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.281361] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.281361] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.281361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.281653] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 747.344493] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.344751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.344751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.344914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.345061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.359178] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 747.483746] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: SUCCESS [ 747.483934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.139795] env[69219]: INFO networking_nsxv3.common.synchronization [req-f3063858-d483-4201-b650-65e34fd9d02d req-9e911db0-b8ce-4b8b-9ebf-658f5d191e1a tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 748.140165] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 748.140511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.140653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.140732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.140953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.145368] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.145496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.145569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.145759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.145852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.146012] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.486516] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.487026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.487084] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.487438] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.487821] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.488723] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.488948] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.489301] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.489541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.489889] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.490081] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.490245] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.490411] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.490572] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.490742] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.490927] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.511063] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.511326] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.511549] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.511826] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.512328] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-740c8983-75c7-47b3-9103-f5ecb88414ae taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.512584] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.512790] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.513418] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.514125] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740c8983-75c7-47b3-9103-f5ecb88414ae',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.653625] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.020027] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.020027] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 740c8983-75c7-47b3-9103-f5ecb88414ae not found, creating... [ 749.020027] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.020027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.020698] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.020698] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.020698] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.020698] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.021021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.021286] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 740c8983-75c7-47b3-9103-f5ecb88414ae is going to be created. [ 749.042060] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.042060] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.042060] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.042060] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.042343] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.042904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.154083] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.343945] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7eb3a6e2-3c6c-45d1-bc4d-ed079a8af2d2 None None] Enqueued Resource ID: 34337198-0020-4c5f-a56f-5373380f95a5 with Priority: HIGHEST for action port [ 749.344346] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34337198-0020-4c5f-a56f-5373380f95a5 with Priority: HIGHEST for action port [ 749.344841] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-34337198-0020-4c5f-a56f-5373380f95a5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.345024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34337198-0020-4c5f-a56f-5373380f95a5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.345168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34337198-0020-4c5f-a56f-5373380f95a5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.345470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34337198-0020-4c5f-a56f-5373380f95a5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.345594] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34337198-0020-4c5f-a56f-5373380f95a5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.373447] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 749.375876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.657103] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.657283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.657354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.657565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.657689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.657800] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 749.684898] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.685103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.685103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.685327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.685479] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.694502] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 749.773542] env[69219]: INFO networking_nsxv3.common.synchronization [req-f3063858-d483-4201-b650-65e34fd9d02d req-def90d69-3c2b-4d01-b0a7-41482e2ea490 service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 749.773719] env[69219]: INFO networking_nsxv3.common.synchronization [req-f3063858-d483-4201-b650-65e34fd9d02d req-def90d69-3c2b-4d01-b0a7-41482e2ea490 service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 749.773906] env[69219]: INFO networking_nsxv3.common.synchronization [req-f3063858-d483-4201-b650-65e34fd9d02d req-def90d69-3c2b-4d01-b0a7-41482e2ea490 service nova] Enqueued Resource ID: 740c8983-75c7-47b3-9103-f5ecb88414ae with Priority: HIGHEST for action port [ 749.774152] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 749.774279] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 749.775289] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 740c8983-75c7-47b3-9103-f5ecb88414ae with Priority: HIGHEST for action port [ 749.775289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.775289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.775289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.775899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.775899] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.777048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.777261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.777371] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-740c8983-75c7-47b3-9103-f5ecb88414ae taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.777444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.777483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.777656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.777767] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('740c8983-75c7-47b3-9103-f5ecb88414ae',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.848021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34337198-0020-4c5f-a56f-5373380f95a5 [ 749.848180] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.848884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.848884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.848884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.848884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.849063] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34337198-0020-4c5f-a56f-5373380f95a5 already deleted. [ 749.849191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34337198-0020-4c5f-a56f-5373380f95a5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.036090] env[69219]: INFO networking_nsxv3.common.synchronization [None req-e34f2c65-63f1-424e-a823-82b2321f7a6f tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 750.036612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 750.036916] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.037682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.037786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.038065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.038154] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.136167] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f17b11c1-14ff-4879-b001-0cd80464963e tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 750.136366] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 750.136696] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.136846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.281029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.281029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.281029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 740c8983-75c7-47b3-9103-f5ecb88414ae with status ACTIVE [ 750.281387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.281387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.281387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.281494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.281570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.281745] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.281840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.281899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.282071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.282150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.282326] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.282416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.282475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.282611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.282684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.282767] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 740c8983-75c7-47b3-9103-f5ecb88414ae is going to be updated. [ 750.307937] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.308108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.308180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.308384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.308519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.308702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-740c8983-75c7-47b3-9103-f5ecb88414ae" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.569322] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.569322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.569322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.569447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.569540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.569810] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a already deleted. [ 750.569810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.569922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.570114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.570194] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.092675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.092675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.092675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.092675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.092675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.092675] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a already deleted. [ 751.092675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.705996] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 751.706286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.706286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.706467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.706757] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.706890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.706951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.707163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.707251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.707366] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.768485] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4889f66d-388b-443c-a2b8-bc98f8f21212 None None] Enqueued Resource ID: 06aa37d2-609a-4d3a-a1b5-01140a77fd8d with Priority: HIGHEST for action port [ 751.768819] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06aa37d2-609a-4d3a-a1b5-01140a77fd8d with Priority: HIGHEST for action port [ 751.769416] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-06aa37d2-609a-4d3a-a1b5-01140a77fd8d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.769546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06aa37d2-609a-4d3a-a1b5-01140a77fd8d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.769597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06aa37d2-609a-4d3a-a1b5-01140a77fd8d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.769868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06aa37d2-609a-4d3a-a1b5-01140a77fd8d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.769954] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06aa37d2-609a-4d3a-a1b5-01140a77fd8d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.210693] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.276014] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06aa37d2-609a-4d3a-a1b5-01140a77fd8d [ 752.276276] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.276416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.276488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.276753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.276853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.276968] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06aa37d2-609a-4d3a-a1b5-01140a77fd8d already deleted. [ 752.277063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06aa37d2-609a-4d3a-a1b5-01140a77fd8d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.713122] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.218651] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.218959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.218959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.219212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.219306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.219479] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 753.249524] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.249688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.249785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.250166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.250263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.259958] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 755.270603] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 755.270603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.270937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.271120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.271316] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.272661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.272661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.272661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.272661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.272661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.272661] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.775026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.775126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.775126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.775396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.775655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.775739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.775739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.775981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.776053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.776105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.776257] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.776345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.776401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.776535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.777030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.777030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.777030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.777030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.777210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.777210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.777266] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.282439] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b911077-41e4-4e60-b59f-e672bb56c601: rpc.has_security_group_logging(os_id): False [ 756.303096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.303096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.303096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.303096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.303674] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.303674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.303674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.303674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.303674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.303674] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 756.361940] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.361940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.361940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.361940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.361940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.376167] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 756.769684] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 756.770096] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 757.741767] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c8981793-1ff7-4bf9-bb32-1860325787b1 None None] Enqueued Resource ID: fbdba904-b123-4431-acf7-46e4188f649f with Priority: HIGHEST for action port [ 757.742121] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbdba904-b123-4431-acf7-46e4188f649f with Priority: HIGHEST for action port [ 757.742745] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbdba904-b123-4431-acf7-46e4188f649f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.742874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbdba904-b123-4431-acf7-46e4188f649f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.742950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbdba904-b123-4431-acf7-46e4188f649f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.743629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbdba904-b123-4431-acf7-46e4188f649f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.743721] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbdba904-b123-4431-acf7-46e4188f649f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.246746] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbdba904-b123-4431-acf7-46e4188f649f [ 758.247076] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.247231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.247325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.247580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.247679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.247777] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbdba904-b123-4431-acf7-46e4188f649f already deleted. [ 758.247923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbdba904-b123-4431-acf7-46e4188f649f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.392304] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 758.392531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.677230] env[69219]: INFO networking_nsxv3.common.synchronization [None req-a84ba80d-c3c0-4cda-a2c3-478a5d4599a9 None None] Enqueued Resource ID: 0acae82b-55a7-491f-ae69-0a6ec14b7726 with Priority: HIGHEST for action port [ 759.677597] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0acae82b-55a7-491f-ae69-0a6ec14b7726 with Priority: HIGHEST for action port [ 759.678418] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0acae82b-55a7-491f-ae69-0a6ec14b7726 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.678547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0acae82b-55a7-491f-ae69-0a6ec14b7726" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.678618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0acae82b-55a7-491f-ae69-0a6ec14b7726" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.678932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0acae82b-55a7-491f-ae69-0a6ec14b7726" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.679037] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acae82b-55a7-491f-ae69-0a6ec14b7726',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.091391] env[69219]: INFO networking_nsxv3.common.synchronization [req-3a05eaac-31eb-4ed5-b692-fb45c63d21ab req-3e5d8f4e-3246-4bda-a029-c68dd5aed3e1 tempest-ImagesNegativeTestJSON-311492513 tempest-ImagesNegativeTestJSON-311492513-project-member] Enqueued Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_members [ 760.092296] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_members [ 760.092706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.092839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.092906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.093183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.093318] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.093411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.093460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.093606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.093692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.093816] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.182945] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0acae82b-55a7-491f-ae69-0a6ec14b7726 [ 760.182945] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.182945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.182945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.182945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.182945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.182945] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0acae82b-55a7-491f-ae69-0a6ec14b7726 already deleted. [ 760.182945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0acae82b-55a7-491f-ae69-0a6ec14b7726" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.408208] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.408487] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-820" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.408975] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-820" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.408975] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-820" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.409317] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.409523] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.409711] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.409978] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.410175] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.410415] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.410558] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.410693] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.410829] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.411121] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 760.411121] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.411248] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.431511] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.431678] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 760.431821] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.432016] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-820" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.432341] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-7f92f6db-0e22-465e-bdff-28c6115a8a44 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.432512] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.432640] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.433041] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.433201] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f92f6db-0e22-465e-bdff-28c6115a8a44',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.595326] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.595599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.595685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.595964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.596118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.596370] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.596547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.596648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.596873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.597012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.597134] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 already deleted. [ 760.597224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.935715] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.936059] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.936194] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.936526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.936759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.936977] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 7f92f6db-0e22-465e-bdff-28c6115a8a44 not found, creating... [ 760.937302] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.937518] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.937661] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.937909] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.938241] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.938527] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.938774] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.938950] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.939223] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.939431] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.939632] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 7f92f6db-0e22-465e-bdff-28c6115a8a44 is going to be created. [ 760.962096] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.962287] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.962416] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.962703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.962933] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.963169] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.646450] env[69219]: INFO networking_nsxv3.common.synchronization [req-3a05eaac-31eb-4ed5-b692-fb45c63d21ab req-6aa0a35c-75e8-4283-bd48-499090b67577 service nova] Enqueued Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_rules [ 761.646450] env[69219]: INFO networking_nsxv3.common.synchronization [req-3a05eaac-31eb-4ed5-b692-fb45c63d21ab req-6aa0a35c-75e8-4283-bd48-499090b67577 service nova] Enqueued Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_members [ 761.646450] env[69219]: INFO networking_nsxv3.common.synchronization [req-3a05eaac-31eb-4ed5-b692-fb45c63d21ab req-6aa0a35c-75e8-4283-bd48-499090b67577 service nova] Enqueued Resource ID: 7f92f6db-0e22-465e-bdff-28c6115a8a44 with Priority: HIGHEST for action port [ 761.646450] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_rules [ 761.646450] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_members [ 761.646740] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f92f6db-0e22-465e-bdff-28c6115a8a44 with Priority: HIGHEST for action port [ 761.648023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.648341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.648531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.648891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.649090] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.650164] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.651395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.655128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.655128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.655517] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.655517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.655517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.655667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.655709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.655773] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.656610] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f92f6db-0e22-465e-bdff-28c6115a8a44 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.656722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.656791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.656943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.657030] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f92f6db-0e22-465e-bdff-28c6115a8a44',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.160035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.160035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.160035] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.162615] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f92f6db-0e22-465e-bdff-28c6115a8a44 with status ACTIVE [ 762.162615] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.162615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.162615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.162841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.162899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.163245] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.163245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.163245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.163392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.163465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.163667] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.163725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.164302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.164302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.164302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.164302] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f92f6db-0e22-465e-bdff-28c6115a8a44 is going to be updated. [ 762.185020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.185176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.185233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.185476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.185645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.185848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f92f6db-0e22-465e-bdff-28c6115a8a44" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.663123] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.168423] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.168700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.168700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.168948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.169041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.169176] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 is going to be created. [ 763.191956] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.192177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.192275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.193031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.193031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.201141] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 in Status: UNINITIALIZED for 2s [ 763.466397] env[69219]: INFO networking_nsxv3.common.synchronization [req-f6c60063-9101-43b8-97d8-3bd497904f04 req-ffa80c04-a6ed-48ec-9f84-194624e9c229 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 763.466993] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 763.467321] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.467442] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.467510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.467703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.467855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.467954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.469428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.469428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.469428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.469428] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.723187] env[69219]: INFO networking_nsxv3.common.synchronization [req-7b8d14bb-6c25-4a46-a4c0-51e282b626fb req-850e75a1-9115-4e89-b73a-4dd18dad84ff tempest-ServerGroupTestJSON-315075382 tempest-ServerGroupTestJSON-315075382-project-member] Enqueued Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_members [ 763.723670] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_members [ 763.724498] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.724498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.724498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.724498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.724731] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.724731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.724834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.724933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.725022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.725166] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.971199] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.971342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.971386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.971610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.972283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.972283] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.972283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.972283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.972283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.972283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.972525] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 764.002402] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.002579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.002617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.003043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.003043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.012957] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 764.060737] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.060737] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-755" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.060737] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-755" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.060737] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-755" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.060737] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.060737] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.060737] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.061466] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.061747] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.062956] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.063027] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.063156] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.063270] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.063386] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.064031] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.064031] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.081252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.081438] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.081607] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.081729] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-755" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.082060] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-e0953d75-dfba-4aac-9ef6-c0600d39a54c taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.082234] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.082349] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.082687] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.082831] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0953d75-dfba-4aac-9ef6-c0600d39a54c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.229019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.229019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.229019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.229673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c already deleted. [ 764.229673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.587075] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.587558] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.588187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.588187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.588187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.588305] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port e0953d75-dfba-4aac-9ef6-c0600d39a54c not found, creating... [ 764.588760] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.588977] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.589144] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.589434] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.589642] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.589981] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.593027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.593027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.593027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.593027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.593027] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: e0953d75-dfba-4aac-9ef6-c0600d39a54c is going to be created. [ 764.618994] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.618994] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.618994] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.618994] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.619232] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.619446] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.210485] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 in Status: SUCCESS [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.212897] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.212897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.212897] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.542742] env[69219]: INFO networking_nsxv3.common.synchronization [req-7b8d14bb-6c25-4a46-a4c0-51e282b626fb req-c720138d-3faa-4f22-8394-96eed5491643 service nova] Enqueued Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_rules [ 765.543056] env[69219]: INFO networking_nsxv3.common.synchronization [req-7b8d14bb-6c25-4a46-a4c0-51e282b626fb req-c720138d-3faa-4f22-8394-96eed5491643 service nova] Enqueued Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_members [ 765.543056] env[69219]: INFO networking_nsxv3.common.synchronization [req-7b8d14bb-6c25-4a46-a4c0-51e282b626fb req-c720138d-3faa-4f22-8394-96eed5491643 service nova] Enqueued Resource ID: e0953d75-dfba-4aac-9ef6-c0600d39a54c with Priority: HIGHEST for action port [ 765.543286] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_rules [ 765.543410] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_members [ 765.543507] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0953d75-dfba-4aac-9ef6-c0600d39a54c with Priority: HIGHEST for action port [ 765.544579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.544733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.544784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.545074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.545146] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.545950] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.550018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.550018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.550018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0953d75-dfba-4aac-9ef6-c0600d39a54c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.550018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.550018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0953d75-dfba-4aac-9ef6-c0600d39a54c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.715129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.715310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.715528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.715887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.716097] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.716315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.716384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.716594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.716813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.716999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.717234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.718275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.718275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.718275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.718275] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.718275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.718275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.718275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.718578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.718708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.719465] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.024625] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 766.024625] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 766.025069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.050855] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.053719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.053719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.053719] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0953d75-dfba-4aac-9ef6-c0600d39a54c with status ACTIVE [ 766.053719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.053719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.053719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.053719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.053719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.053719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.053719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.053719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.054174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.054174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.055015] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.055015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.055015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.055015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.055015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.055015] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0953d75-dfba-4aac-9ef6-c0600d39a54c is going to be updated. [ 766.078365] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.078548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.078639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.078976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.079164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.079358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0953d75-dfba-4aac-9ef6-c0600d39a54c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.222225] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd19ce54-2cd0-4cbf-976d-9f64e5909283: rpc.has_security_group_logging(os_id): False [ 766.242709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.242883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.242922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.243145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.243237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.243427] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.243526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.243580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.243723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.243799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.244099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.244260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.244473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.244606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.245302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.245500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.245593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.245780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.245780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.245873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.247054] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 is going to be created. [ 766.308049] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.308049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.308049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.308387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.308498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.324223] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 in Status: IN_PROGRESS for 2s [ 766.552739] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.055982] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.056151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.056264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.056444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.056564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.057106] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c is going to be created. [ 767.077979] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.078171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.078234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.078660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.078660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.098134] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c in Status: UNINITIALIZED for 2s [ 768.336558] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 in Status: SUCCESS [ 768.336914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.107197] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c in Status: SUCCESS [ 769.107406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.107568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.107775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.108000] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.108088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.108135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.108281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.108385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.108438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.108517] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.499827] env[69219]: INFO networking_nsxv3.common.synchronization [None req-ba0e3b5c-b848-4468-8fb2-4e35bdd66b51 None None] Enqueued Resource ID: 0f774921-6754-4451-918a-4e6f61ce6535 with Priority: HIGHEST for action port [ 769.500241] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f774921-6754-4451-918a-4e6f61ce6535 with Priority: HIGHEST for action port [ 769.500348] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f774921-6754-4451-918a-4e6f61ce6535 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.500464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f774921-6754-4451-918a-4e6f61ce6535" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.503761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f774921-6754-4451-918a-4e6f61ce6535" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.503761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f774921-6754-4451-918a-4e6f61ce6535" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.503761] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f774921-6754-4451-918a-4e6f61ce6535',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.612138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.612138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.612138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.612138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.612670] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.612993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.612993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.613103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.613230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.613361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.613558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.613813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.613813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.613981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.614190] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.614327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.614418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.614597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.614728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.614868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.615086] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.006184] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f774921-6754-4451-918a-4e6f61ce6535 [ 770.006476] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.006618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.006898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.006898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.007027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.007077] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f774921-6754-4451-918a-4e6f61ce6535 already deleted. [ 770.007166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f774921-6754-4451-918a-4e6f61ce6535" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.123411] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c: rpc.has_security_group_logging(os_id): False [ 770.140991] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.141206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.141383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.141570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.141660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.141886] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.141989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.142109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.142220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.142329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.142524] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.142659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.142659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.142852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.142944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.143768] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.145023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.145023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.145023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.145023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.145023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c is going to be created. [ 770.198414] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.198560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.198611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.198904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.199213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.214129] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c in Status: IN_PROGRESS for 2s [ 770.531258] env[69219]: INFO networking_nsxv3.common.synchronization [req-2cac1e91-bdfb-4cca-80f0-54377884811e req-594b1f02-a56b-4343-98d8-41c8b9360ad8 tempest-VolumesAssistedSnapshotsTest-1735245712 tempest-VolumesAssistedSnapshotsTest-1735245712-project-member] Enqueued Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_members [ 770.531842] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGHEST for action security_group_members [ 770.532464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.532635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.532704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.532925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.533086] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.533182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.533241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.533388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.533468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.533561] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.036563] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.036563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.036563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.036756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.036806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.037791] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.037791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.037791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.037791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.037791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.037791] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6f62def-0bf8-403b-b778-966080958ecc is going to be updated. [ 771.064728] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.064869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.064955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.065378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.065378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.074066] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6f62def-0bf8-403b-b778-966080958ecc in Status: IN_PROGRESS for 2s [ 771.966961] env[69219]: INFO networking_nsxv3.common.synchronization [None req-67b9baf9-7c27-41ff-812c-b4e8ccf4dd43 None None] Enqueued Resource ID: b34dd9cb-8b24-43ab-93bd-72470986170d with Priority: HIGHEST for action port [ 771.967273] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b34dd9cb-8b24-43ab-93bd-72470986170d with Priority: HIGHEST for action port [ 771.967823] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b34dd9cb-8b24-43ab-93bd-72470986170d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.967975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b34dd9cb-8b24-43ab-93bd-72470986170d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.968038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b34dd9cb-8b24-43ab-93bd-72470986170d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.968291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b34dd9cb-8b24-43ab-93bd-72470986170d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.968388] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b34dd9cb-8b24-43ab-93bd-72470986170d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.189319] env[69219]: INFO networking_nsxv3.common.synchronization [req-d32ed256-d284-497a-98dc-4c32858c64c6 req-99703b82-1622-45e5-9dba-384b212f69c8 tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 772.189871] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 772.190179] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.190299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.190364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.193556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.193778] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.193943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.194020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.194235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.194362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.194483] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.225233] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c in Status: SUCCESS [ 772.225233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.372368] env[69219]: INFO networking_nsxv3.common.synchronization [req-2b5a6e17-5030-4dd0-8a24-b5dfe1411c12 req-e468ce87-b154-4815-8e2a-ba07fb5b4f58 tempest-ImagesNegativeTestJSON-311492513 tempest-ImagesNegativeTestJSON-311492513-project-member] Enqueued Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_members [ 772.372368] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGHEST for action security_group_members [ 772.372617] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.372617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.372617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.372803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.372900] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.372996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.377974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.378250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.378380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.378490] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.473256] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b34dd9cb-8b24-43ab-93bd-72470986170d [ 772.473529] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.473663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.473733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.473950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.474061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.474156] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b34dd9cb-8b24-43ab-93bd-72470986170d already deleted. [ 772.474258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b34dd9cb-8b24-43ab-93bd-72470986170d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.557852] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.558058] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.558233] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.558602] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.558947] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.559184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.559354] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.559585] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.559762] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.559992] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.560111] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.560220] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.560329] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.560438] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 772.560543] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.560681] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.579373] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.579558] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 772.579660] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.579812] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.580078] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-17315053-c056-41bd-bcb3-f53bb3f0c019 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.580234] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.580606] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.580606] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.580737] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17315053-c056-41bd-bcb3-f53bb3f0c019',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.698560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.698560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.698560] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee already deleted. [ 772.698560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.881777] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.883036] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.883036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.883036] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 is going to be updated. [ 772.911670] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.911799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.911799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.913395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.913395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.920367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 in Status: IN_PROGRESS for 2s [ 773.083269] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.083612] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.083612] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.083886] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.084046] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.084199] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 17315053-c056-41bd-bcb3-f53bb3f0c019 not found, creating... [ 773.084455] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.084612] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.084724] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.084956] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.085122] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.085402] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.085554] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.085667] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.085869] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.086612] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.086612] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 17315053-c056-41bd-bcb3-f53bb3f0c019 is going to be created. [ 773.087689] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6f62def-0bf8-403b-b778-966080958ecc in Status: SUCCESS [ 773.087837] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6f62def-0bf8-403b-b778-966080958ecc deletion is rescheduled due to dependency. [ 773.087952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.106074] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.106288] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.106412] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.106824] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.107109] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.107340] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.798217] env[69219]: INFO networking_nsxv3.common.synchronization [req-d32ed256-d284-497a-98dc-4c32858c64c6 req-9bb08801-9039-4941-b760-debc95ce5737 service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 773.798399] env[69219]: INFO networking_nsxv3.common.synchronization [req-d32ed256-d284-497a-98dc-4c32858c64c6 req-9bb08801-9039-4941-b760-debc95ce5737 service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 773.798536] env[69219]: INFO networking_nsxv3.common.synchronization [req-d32ed256-d284-497a-98dc-4c32858c64c6 req-9bb08801-9039-4941-b760-debc95ce5737 service nova] Enqueued Resource ID: 17315053-c056-41bd-bcb3-f53bb3f0c019 with Priority: HIGHEST for action port [ 773.798766] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 773.798917] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 773.799085] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17315053-c056-41bd-bcb3-f53bb3f0c019 with Priority: HIGHEST for action port [ 773.799657] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.799786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.799877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.800159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.800265] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.801121] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.801259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.801349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.801534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.801706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.801829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.801912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.802122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.802172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.802250] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.803272] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-17315053-c056-41bd-bcb3-f53bb3f0c019 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.805231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.805313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.805486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.805598] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17315053-c056-41bd-bcb3-f53bb3f0c019',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.308058] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.311860] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.311992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.313303] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17315053-c056-41bd-bcb3-f53bb3f0c019 with status ACTIVE [ 774.313303] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.313303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.313303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.313303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.313303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.313303] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.313303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.313658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.313658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.313658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.313800] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.313848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.314166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.314166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.314166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.314300] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17315053-c056-41bd-bcb3-f53bb3f0c019 is going to be updated. [ 774.334075] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.334075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.334199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.334343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.334835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.334835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17315053-c056-41bd-bcb3-f53bb3f0c019" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.817166] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.930571] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 in Status: SUCCESS [ 774.930571] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 deletion is rescheduled due to dependency. [ 774.930571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.320287] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.320638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.320638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.321211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.321211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.321211] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be created. [ 775.344268] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.344424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.344496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.344705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.344884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.356996] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: UNINITIALIZED for 2s [ 776.937406] env[69219]: INFO networking_nsxv3.common.synchronization [req-a86a2305-81c0-42e6-982d-2d8165304701 req-0e450c22-48bf-4f75-adfb-42c42d16db7a tempest-ServerGroupTestJSON-315075382 tempest-ServerGroupTestJSON-315075382-project-member] Enqueued Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_members [ 776.939023] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGHEST for action security_group_members [ 776.939023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.939023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.939023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.939459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.940024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.940024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.940024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.940337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.940496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.941655] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.093893] env[69219]: INFO networking_nsxv3.common.synchronization [req-1587aad5-e05e-4c9f-9f63-1cd266e7e139 req-10bb2874-3f21-4afb-bc3f-fb0d45da88d5 tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 777.094416] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 777.094855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.094855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.095018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.095633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.095720] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.096586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.096586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.096586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.096586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.096586] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.367331] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 777.367540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.367703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.367922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.368128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.368245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.368304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.368454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.368533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.368617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.368706] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.445055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.445205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.445284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.445510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.445598] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.445792] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.445889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.447017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.447017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.447017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.447017] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c is going to be updated. [ 777.476803] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.477033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.477201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.479540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.479540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.487631] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c in Status: IN_PROGRESS for 2s [ 777.599419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.599419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.599419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 already deleted. [ 777.599419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.642130] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.642130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.642130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.642130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.642130] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.642130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.642130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.642130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.642130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.642130] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.644621] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.644762] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.644876] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.644993] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.645113] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.645501] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.666493] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.666749] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.666830] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.667330] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.667330] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-cab4653c-e289-4ef1-8b2e-5f8239db591d taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.667496] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.667568] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.668092] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.668092] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab4653c-e289-4ef1-8b2e-5f8239db591d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.871567] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.949418] env[69219]: INFO networking_nsxv3.common.synchronization [None req-9911956d-2403-46bb-a9de-afbdc210d7c5 None None] Enqueued Resource ID: 489d8a6f-ad6b-435b-967a-592a009c3e67 with Priority: HIGHEST for action port [ 777.950105] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 489d8a6f-ad6b-435b-967a-592a009c3e67 with Priority: HIGHEST for action port [ 777.950432] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-489d8a6f-ad6b-435b-967a-592a009c3e67 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.952383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-489d8a6f-ad6b-435b-967a-592a009c3e67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.952383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-489d8a6f-ad6b-435b-967a-592a009c3e67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.952383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-489d8a6f-ad6b-435b-967a-592a009c3e67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.952383] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('489d8a6f-ad6b-435b-967a-592a009c3e67',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.170399] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.170756] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.170756] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.171075] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.171255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.171417] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port cab4653c-e289-4ef1-8b2e-5f8239db591d not found, creating... [ 778.171683] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.171947] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.172016] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.172209] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.172350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.172626] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.173406] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.173406] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.173406] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.173406] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.173406] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: cab4653c-e289-4ef1-8b2e-5f8239db591d is going to be created. [ 778.193889] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.194278] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.194416] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.194704] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.194936] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.195183] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.375419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39c47700-2196-4adc-afd5-b72e818055ee: rpc.has_security_group_logging(os_id): False [ 778.395791] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.395988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.396076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.400023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.400023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.400023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.400023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.400023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.400023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.400023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.400023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be created. [ 778.453355] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.453355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.453355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.453355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.453355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.454977] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 489d8a6f-ad6b-435b-967a-592a009c3e67 [ 778.454977] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.454977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.454977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.454977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.455272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.455272] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:489d8a6f-ad6b-435b-967a-592a009c3e67 already deleted. [ 778.455272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-489d8a6f-ad6b-435b-967a-592a009c3e67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.463876] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 778.883249] env[69219]: INFO networking_nsxv3.common.synchronization [req-1587aad5-e05e-4c9f-9f63-1cd266e7e139 req-301420ee-531e-46ad-bd6f-89a636521aaa service nova] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_rules [ 778.883249] env[69219]: INFO networking_nsxv3.common.synchronization [req-1587aad5-e05e-4c9f-9f63-1cd266e7e139 req-301420ee-531e-46ad-bd6f-89a636521aaa service nova] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 778.883249] env[69219]: INFO networking_nsxv3.common.synchronization [req-1587aad5-e05e-4c9f-9f63-1cd266e7e139 req-301420ee-531e-46ad-bd6f-89a636521aaa service nova] Enqueued Resource ID: cab4653c-e289-4ef1-8b2e-5f8239db591d with Priority: HIGHEST for action port [ 778.883249] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_rules [ 778.883249] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 778.883249] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cab4653c-e289-4ef1-8b2e-5f8239db591d with Priority: HIGHEST for action port [ 778.883998] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.886981] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.886981] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.886981] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.886981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.888435] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.890691] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cab4653c-e289-4ef1-8b2e-5f8239db591d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.890691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.890691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.890691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.890691] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab4653c-e289-4ef1-8b2e-5f8239db591d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.231425] env[69219]: INFO networking_nsxv3.common.synchronization [req-5944b0fe-738e-47d5-afc4-032e38169394 req-0c968e9f-17f0-425d-a12f-f7c250fb8841 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 779.232079] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 779.232252] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.233021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.233021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.233021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.233021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.233021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.233021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.234561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.234657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.234755] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.393195] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.393277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.395182] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.395794] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cab4653c-e289-4ef1-8b2e-5f8239db591d with status ACTIVE [ 779.396020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.396184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.396275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.396519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.396641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.396851] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.396964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.397041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.397235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.397325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.397513] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.397636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.397700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.397846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.397945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.402019] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cab4653c-e289-4ef1-8b2e-5f8239db591d is going to be updated. [ 779.420552] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.420710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.420779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.420973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.421394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.421524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cab4653c-e289-4ef1-8b2e-5f8239db591d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.504318] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c in Status: SUCCESS [ 779.504515] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c deletion is rescheduled due to dependency. [ 779.504690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.555734] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.555734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.555734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.555932] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.556237] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.556400] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.556514] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.556749] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.557068] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.557330] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.557452] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.557563] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.557679] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.557785] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.557965] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.558084] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.578103] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.578103] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.578103] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.578103] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.578103] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-fc9e8471-7d07-41ef-b80f-2ee605594798 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.578103] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.578103] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.578567] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.578718] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9e8471-7d07-41ef-b80f-2ee605594798',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.740049] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.740280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.740417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.740606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.740745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.740972] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.741433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.741433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.741433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.741433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.741568] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 already deleted. [ 779.741616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.903631] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.081397] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.081623] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.081747] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.082294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.082294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.082582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port fc9e8471-7d07-41ef-b80f-2ee605594798 not found, creating... [ 780.082906] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.083401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.083401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.083401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.083923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.083923] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.084023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.084092] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.084285] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.084414] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.084701] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: fc9e8471-7d07-41ef-b80f-2ee605594798 is going to be created. [ 780.104358] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.104562] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.104689] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.105621] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.108245] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.108245] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.406138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.406438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.406488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.406756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.406890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.407019] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be created. [ 780.429963] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.430146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.430211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.430408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.430561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.451773] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: UNINITIALIZED for 2s [ 780.474992] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 780.475304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.276514] env[69219]: INFO networking_nsxv3.common.synchronization [req-5944b0fe-738e-47d5-afc4-032e38169394 req-f6200587-8c9b-4036-b306-48df152c19e9 service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 781.276696] env[69219]: INFO networking_nsxv3.common.synchronization [req-5944b0fe-738e-47d5-afc4-032e38169394 req-f6200587-8c9b-4036-b306-48df152c19e9 service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 781.276871] env[69219]: INFO networking_nsxv3.common.synchronization [req-5944b0fe-738e-47d5-afc4-032e38169394 req-f6200587-8c9b-4036-b306-48df152c19e9 service nova] Enqueued Resource ID: fc9e8471-7d07-41ef-b80f-2ee605594798 with Priority: HIGHEST for action port [ 781.277481] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 781.277481] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 781.277481] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc9e8471-7d07-41ef-b80f-2ee605594798 with Priority: HIGHEST for action port [ 781.277942] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.278014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.278080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.278321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.278408] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.279244] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.279357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.279425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.279580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.279744] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.279809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.279894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.280073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.280162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.280259] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.281051] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc9e8471-7d07-41ef-b80f-2ee605594798 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.281163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.281231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.281380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.281459] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc9e8471-7d07-41ef-b80f-2ee605594798',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.783958] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.784659] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.784659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.784659] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc9e8471-7d07-41ef-b80f-2ee605594798 with status ACTIVE [ 781.784803] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.784967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.784967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.785412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.785412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.785412] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.785566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.785566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.785719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.785747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.786307] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.786307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.788030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.788134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.788190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.788579] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc9e8471-7d07-41ef-b80f-2ee605594798 is going to be updated. [ 781.827302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.827500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.827500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.828084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.828084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.828084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc9e8471-7d07-41ef-b80f-2ee605594798" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.291251] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.464500] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 782.464601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.464774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.464991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.465476] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.465612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.465932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.466124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.466213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.466305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.466400] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.793944] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.793944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.793944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.794404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.794404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.794404] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be created. [ 782.819172] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.819498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.819498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.820035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.820244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.828895] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: UNINITIALIZED for 2s [ 782.866176] env[69219]: INFO networking_nsxv3.common.synchronization [None req-a6615407-d06e-4ba5-bf86-c029c41c82cb None None] Enqueued Resource ID: c1d65223-54c4-4bda-8363-c46b16d64172 with Priority: HIGHEST for action port [ 782.866272] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d65223-54c4-4bda-8363-c46b16d64172 with Priority: HIGHEST for action port [ 782.866800] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1d65223-54c4-4bda-8363-c46b16d64172 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.866919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1d65223-54c4-4bda-8363-c46b16d64172" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.866984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1d65223-54c4-4bda-8363-c46b16d64172" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.867362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1d65223-54c4-4bda-8363-c46b16d64172" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.867536] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1d65223-54c4-4bda-8363-c46b16d64172',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.969312] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.969583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.969583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.969751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.969994] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.970143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.970214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.970385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.970477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.970576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.970738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.970838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.970899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.971051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.971383] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.971383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.971383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.971558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.971601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.971670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.971760] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.180995] env[69219]: INFO networking_nsxv3.common.synchronization [req-da24ce10-821a-4dcd-9307-146102b92346 req-d21c70f3-b017-4ae4-9018-16306e20d646 tempest-ImagesOneServerTestJSON-1012517002 tempest-ImagesOneServerTestJSON-1012517002-project-member] Enqueued Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_members [ 783.181610] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_members [ 783.181929] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.182066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.182126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.182381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.182535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.182656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.182711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.182838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.182925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.186083] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.374241] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1d65223-54c4-4bda-8363-c46b16d64172 [ 783.374241] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.374241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.374241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.374241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.374241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.374455] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1d65223-54c4-4bda-8363-c46b16d64172 already deleted. [ 783.374455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1d65223-54c4-4bda-8363-c46b16d64172" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.475602] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 825c0c18-33c1-4cb4-8480-e8d82499bbf3: rpc.has_security_group_logging(os_id): False [ 783.492357] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.492499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.492571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.492797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.492873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.493095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.493186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.493259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.493440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.493520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.493700] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.493793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.493852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.493988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.494099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.494255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.494345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.494398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.494530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.494602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.494692] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be created. [ 783.583482] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.583713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.583713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.584745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.584745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.626100] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 783.689545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.689702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.689769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.689985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.690198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.690286] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.690426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.690468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.692017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.692017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.692017] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 already deleted. [ 783.692017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.727349] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.727911] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-194" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.727911] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-194" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.728140] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-194" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.728470] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.729180] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.729180] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.729435] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.730862] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.730862] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 783.730862] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.730862] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.730862] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.730862] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 783.730862] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.730862] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.750572] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.750742] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 783.750879] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.751101] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-194" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.751970] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-6515a865-93c2-4cd0-8e48-3104fcbd70d0 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.751970] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.751970] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.752149] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.752275] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6515a865-93c2-4cd0-8e48-3104fcbd70d0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.255342] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.259021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 6515a865-93c2-4cd0-8e48-3104fcbd70d0 not found, creating... [ 784.259021] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.259021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.259522] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.259522] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.259522] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.259522] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.259522] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.259522] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 6515a865-93c2-4cd0-8e48-3104fcbd70d0 is going to be created. [ 784.280282] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.280282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.280282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.280282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.280282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.280282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.304217] env[69219]: INFO networking_nsxv3.common.synchronization [None req-91d63098-56e2-4277-a363-f65331eb6140 None None] Enqueued Resource ID: 50f7d59a-23fd-4910-a241-ab52e9884b18 with Priority: HIGHEST for action port [ 784.304217] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f7d59a-23fd-4910-a241-ab52e9884b18 with Priority: HIGHEST for action port [ 784.304217] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f7d59a-23fd-4910-a241-ab52e9884b18 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.304217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f7d59a-23fd-4910-a241-ab52e9884b18" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.304217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f7d59a-23fd-4910-a241-ab52e9884b18" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.304217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f7d59a-23fd-4910-a241-ab52e9884b18" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.304217] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f7d59a-23fd-4910-a241-ab52e9884b18',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.807215] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50f7d59a-23fd-4910-a241-ab52e9884b18 [ 784.807798] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.808617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.808810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.809143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.809443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.810214] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50f7d59a-23fd-4910-a241-ab52e9884b18 already deleted. [ 784.810351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f7d59a-23fd-4910-a241-ab52e9884b18" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.838488] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.842325] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.842325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.842325] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.046355] env[69219]: INFO networking_nsxv3.common.synchronization [None req-08d80169-9a94-45af-9e3b-983477e50efc tempest-ServersTestFqdnHostnames-37187543 tempest-ServersTestFqdnHostnames-37187543-project-member] Enqueued Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_rules [ 785.046355] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_rules [ 785.046355] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.046355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.046355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.046790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.048438] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.202818] env[69219]: INFO networking_nsxv3.common.synchronization [None req-56664a31-65b2-4cff-9807-9492d7b5a484 tempest-ServersTestFqdnHostnames-37187543 tempest-ServersTestFqdnHostnames-37187543-project-member] Enqueued Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_rules [ 785.203376] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_rules [ 785.203672] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.203773] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.271379] env[69219]: INFO networking_nsxv3.common.synchronization [req-a5502450-d290-4058-9410-6b9297624be1 req-b9e9f5f2-72a5-4762-9929-57ca0925c61c tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 785.271379] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 785.271379] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.271379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.271379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.271379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.271379] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.271379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.271379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.271997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.271997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.272597] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.347832] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.348016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.348178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.348433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.348635] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.348771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.348916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.349217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.349353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.349475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.349832] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.350358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.350464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.350653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.350837] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.350977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.351202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.351409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.351536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.351633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.351752] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.374339] env[69219]: INFO networking_nsxv3.common.synchronization [req-a5502450-d290-4058-9410-6b9297624be1 req-b9e9f5f2-72a5-4762-9929-57ca0925c61c tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 785.374558] env[69219]: INFO networking_nsxv3.common.synchronization [req-a5502450-d290-4058-9410-6b9297624be1 req-b9e9f5f2-72a5-4762-9929-57ca0925c61c tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 785.374744] env[69219]: INFO networking_nsxv3.common.synchronization [req-a5502450-d290-4058-9410-6b9297624be1 req-b9e9f5f2-72a5-4762-9929-57ca0925c61c tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 with Priority: HIGHEST for action port [ 785.378194] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 785.378194] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 785.378194] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 with Priority: HIGHEST for action port [ 785.378194] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.378194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.378194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.378194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.378194] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.378979] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.379131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.379357] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c975cd8a-a8bb-4f65-8651-0a10e691cd10 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.379550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.379604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.379908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.380020] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c975cd8a-a8bb-4f65-8651-0a10e691cd10',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.567234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.568699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.568794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.569026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.569131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.569252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d already deleted. [ 785.569311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.569814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.569996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.570753] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.586203] env[69219]: INFO networking_nsxv3.common.synchronization [req-da24ce10-821a-4dcd-9307-146102b92346 req-d83b4c3f-ade5-4a2a-aa9a-6a1558f8c9b1 service nova] Enqueued Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_rules [ 785.587104] env[69219]: INFO networking_nsxv3.common.synchronization [req-da24ce10-821a-4dcd-9307-146102b92346 req-d83b4c3f-ade5-4a2a-aa9a-6a1558f8c9b1 service nova] Enqueued Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_members [ 785.587388] env[69219]: INFO networking_nsxv3.common.synchronization [req-da24ce10-821a-4dcd-9307-146102b92346 req-d83b4c3f-ade5-4a2a-aa9a-6a1558f8c9b1 service nova] Enqueued Resource ID: 6515a865-93c2-4cd0-8e48-3104fcbd70d0 with Priority: HIGHEST for action port [ 785.588443] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_rules [ 785.588676] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_members [ 785.588895] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6515a865-93c2-4cd0-8e48-3104fcbd70d0 with Priority: HIGHEST for action port [ 785.590279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.590649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.590822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.591215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.591387] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.592455] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.592749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.592887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.596021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.596021] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.596021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-6515a865-93c2-4cd0-8e48-3104fcbd70d0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.596021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.596021] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6515a865-93c2-4cd0-8e48-3104fcbd70d0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.640086] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 785.640316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.775394] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.856818] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0687614d-5fbe-486f-942e-47e8dcdc82e2: rpc.has_security_group_logging(os_id): False [ 785.874596] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.874774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.874847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.875049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.875146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.875366] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.875463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.875511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.875785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.875865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.876067] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.879211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.879325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.879673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.879673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.879885] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.879980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.879980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.880201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.880201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.880305] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be created. [ 785.881992] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.881992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.882456] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c975cd8a-a8bb-4f65-8651-0a10e691cd10 with status ACTIVE [ 785.882957] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.883389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.883389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.883389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.883389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.883576] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.883653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.883711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.883860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.883930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.884167] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.884280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.884280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.884430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.884487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.884584] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 is going to be updated. [ 785.915808] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.915990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.916034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.916250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.916370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.916540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.955469] env[69219]: INFO networking_nsxv3.common.synchronization [req-b792bf6f-0db9-4cb0-b6d4-a167a2db2152 req-bfd74501-8283-42a7-89b0-2e403b553165 tempest-FloatingIPsAssociationTestJSON-828494427 tempest-FloatingIPsAssociationTestJSON-828494427-project-member] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 785.955964] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 785.956275] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.956395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.956467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.956643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.956789] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.956884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.956945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.957240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.957437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.957539] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.986143] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.986143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.986143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.986316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.986433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.008371] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 786.096945] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.097141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.101101] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.102018] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6515a865-93c2-4cd0-8e48-3104fcbd70d0 with status ACTIVE [ 786.102258] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.102379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.102445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.102666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.102747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.102925] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.103028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.103028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.103255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.103297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.103488] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.103577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.103635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.103771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.103868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.103918] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6515a865-93c2-4cd0-8e48-3104fcbd70d0 is going to be updated. [ 786.118109] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.118253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.118324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.118524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.118614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.118705] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d already deleted. [ 786.118786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.136302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.136442] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.136514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.136778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.136854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.136990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6515a865-93c2-4cd0-8e48-3104fcbd70d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.160723] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7dfc7766-4732-4937-9a0f-10ecac532307 None None] Enqueued Resource ID: cc34b0ef-589a-4726-8b37-0254223833f6 with Priority: HIGHEST for action port [ 786.160978] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc34b0ef-589a-4726-8b37-0254223833f6 with Priority: HIGHEST for action port [ 786.161560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc34b0ef-589a-4726-8b37-0254223833f6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.161682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc34b0ef-589a-4726-8b37-0254223833f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.161750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc34b0ef-589a-4726-8b37-0254223833f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.162023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc34b0ef-589a-4726-8b37-0254223833f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.163298] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc34b0ef-589a-4726-8b37-0254223833f6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.281413] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.398664] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-249 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.398854] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.399033] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.399301] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.399557] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.399709] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.399822] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.400068] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.400254] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.400429] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.400538] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.400643] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.400746] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.400848] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.400947] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.401089] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.421200] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.421200] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.421200] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.421200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-249" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.421200] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-f8d11894-cb97-49bb-843e-c29bb4167e2a taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.421200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.421200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.421200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.421200] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8d11894-cb97-49bb-843e-c29bb4167e2a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.461423] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.471099] env[69219]: INFO networking_nsxv3.common.synchronization [None req-9b41ccf0-4fd3-4c85-96af-470c15a2634f None None] Enqueued Resource ID: 57dc06c9-a721-4d7a-aff1-77077bca0f06 with Priority: HIGHEST for action port [ 786.471680] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57dc06c9-a721-4d7a-aff1-77077bca0f06 with Priority: HIGHEST for action port [ 786.472460] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-57dc06c9-a721-4d7a-aff1-77077bca0f06 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.472577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57dc06c9-a721-4d7a-aff1-77077bca0f06" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.472642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57dc06c9-a721-4d7a-aff1-77077bca0f06" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.472890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57dc06c9-a721-4d7a-aff1-77077bca0f06" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.472967] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57dc06c9-a721-4d7a-aff1-77077bca0f06',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.607647] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.665943] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc34b0ef-589a-4726-8b37-0254223833f6 [ 786.665943] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.665943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.665943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.665943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.667834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.667971] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc34b0ef-589a-4726-8b37-0254223833f6 already deleted. [ 786.668093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc34b0ef-589a-4726-8b37-0254223833f6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.785591] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.785591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.785591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.785591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.785863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.785863] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be updated. [ 786.836371] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.836519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.836594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.836838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.837103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.847778] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 786.923486] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.923786] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.923926] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.924248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.924404] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.924735] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port f8d11894-cb97-49bb-843e-c29bb4167e2a not found, creating... [ 786.924831] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.925365] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.925365] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.925365] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.925498] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.925786] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.925929] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.926087] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.926277] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.926533] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.926533] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: f8d11894-cb97-49bb-843e-c29bb4167e2a is going to be created. [ 786.947561] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.947780] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.947904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.948189] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.948413] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.948634] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.961060] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.979035] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57dc06c9-a721-4d7a-aff1-77077bca0f06 [ 786.979714] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.979714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.979714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.979714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.979927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.979927] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57dc06c9-a721-4d7a-aff1-77077bca0f06 already deleted. [ 786.980096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57dc06c9-a721-4d7a-aff1-77077bca0f06" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.110743] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.111580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.111580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.111580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.111580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.111580] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 is going to be created. [ 787.136282] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.136428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.136494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.136717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.136905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.146389] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 in Status: UNINITIALIZED for 2s [ 787.463072] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.463463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.463463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.463571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.463654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.463752] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be updated. [ 787.493722] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.493961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.494033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.494276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.494517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.503287] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: IN_PROGRESS for 2s [ 787.635961] env[69219]: INFO networking_nsxv3.common.synchronization [req-b792bf6f-0db9-4cb0-b6d4-a167a2db2152 req-92956688-3667-4b43-8a86-4fba3ee7d720 service nova] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_rules [ 787.636286] env[69219]: INFO networking_nsxv3.common.synchronization [req-b792bf6f-0db9-4cb0-b6d4-a167a2db2152 req-92956688-3667-4b43-8a86-4fba3ee7d720 service nova] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 787.637923] env[69219]: INFO networking_nsxv3.common.synchronization [req-b792bf6f-0db9-4cb0-b6d4-a167a2db2152 req-92956688-3667-4b43-8a86-4fba3ee7d720 service nova] Enqueued Resource ID: f8d11894-cb97-49bb-843e-c29bb4167e2a with Priority: HIGHEST for action port [ 787.638373] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_rules [ 787.638509] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 787.638606] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8d11894-cb97-49bb-843e-c29bb4167e2a with Priority: HIGHEST for action port [ 787.638875] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.639017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.639080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.639288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.639363] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.640220] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.640322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.640510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8d11894-cb97-49bb-843e-c29bb4167e2a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.640595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.640663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.640839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.640925] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8d11894-cb97-49bb-843e-c29bb4167e2a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.021392] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 788.021624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.142499] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.142652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.144997] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8d11894-cb97-49bb-843e-c29bb4167e2a with status ACTIVE [ 788.145203] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.145319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.145385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.145600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.145692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.145859] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.145965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.146027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.146175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.146252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.146429] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.146522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.146585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.146712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.146784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.146865] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8d11894-cb97-49bb-843e-c29bb4167e2a is going to be updated. [ 788.166740] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.166868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.166919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.167103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.167231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.167390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8d11894-cb97-49bb-843e-c29bb4167e2a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.856684] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 788.857114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.857114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.857332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.857520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.857663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.857722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.857879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.857961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.858067] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.156579] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 in Status: SUCCESS [ 789.157039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.157440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.158095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.160426] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.160954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.162019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.162019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.162019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.162019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.162019] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.363152] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.515421] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: SUCCESS [ 789.516023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.516334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.516624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.516922] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.518018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.518018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.518018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.518018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.518018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.663939] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.664131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.664172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.664396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.664579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.664683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.664745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.664901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.664989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.665089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.665233] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.665321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.665378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.665519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.665652] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.665740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.665798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.665931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.666015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.666098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.666183] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.865408] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.020200] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.168288] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27183d48-c6d5-4b19-8477-66d9f0a9fcb7: rpc.has_security_group_logging(os_id): False [ 790.187527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.187680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.187727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.187974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.188125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.188339] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.188476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.188551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.188699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.188770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.189126] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.189205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.189236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.189387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.189461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.189745] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.190102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.190175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.190306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.190381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.190465] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 is going to be created. [ 790.254351] env[69219]: INFO networking_nsxv3.common.synchronization [req-82696809-5644-4dc3-83ef-8f05a8c5b92e req-e4cfb788-26cc-4522-9dfc-f4b7c63c0c75 tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 790.255039] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 790.255462] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.255462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.269250] env[69219]: INFO networking_nsxv3.common.synchronization [req-82696809-5644-4dc3-83ef-8f05a8c5b92e req-e4cfb788-26cc-4522-9dfc-f4b7c63c0c75 tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 790.269404] env[69219]: INFO networking_nsxv3.common.synchronization [req-82696809-5644-4dc3-83ef-8f05a8c5b92e req-e4cfb788-26cc-4522-9dfc-f4b7c63c0c75 tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 790.269544] env[69219]: INFO networking_nsxv3.common.synchronization [req-82696809-5644-4dc3-83ef-8f05a8c5b92e req-e4cfb788-26cc-4522-9dfc-f4b7c63c0c75 tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 with Priority: HIGHEST for action port [ 790.270037] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_rules [ 790.270169] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 790.270243] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 with Priority: HIGHEST for action port [ 790.270507] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.270604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.270794] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.270875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.271213] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c975cd8a-a8bb-4f65-8651-0a10e691cd10 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.271375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.271413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.271590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.271682] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c975cd8a-a8bb-4f65-8651-0a10e691cd10',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.283464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.283464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.283464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.283464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.283622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.294308] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 in Status: IN_PROGRESS for 2s [ 790.370554] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.371435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.371435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.371435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.371435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.371435] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be updated. [ 790.435766] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.435766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.435766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.435766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.437170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.454080] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 790.523258] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.728248] env[69219]: INFO networking_nsxv3.common.synchronization [req-d6d96c12-6390-49b3-b6d0-af7b91d82f82 req-695739bf-1118-4581-b521-aab1e5b7c711 tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 790.729055] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 790.729538] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.729891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.730182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.732688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.732688] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.732688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.732688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.732688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.732688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.732688] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.777393] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c975cd8a-a8bb-4f65-8651-0a10e691cd10 with status ACTIVE [ 790.777393] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.777393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.777393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.777740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.777740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.777905] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.778041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.778123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.778324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.778577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.778742] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.778840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.778907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.780030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.780030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.780030] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c975cd8a-a8bb-4f65-8651-0a10e691cd10 is going to be updated. [ 790.813797] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.813976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.814065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.814305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.814450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.814647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c975cd8a-a8bb-4f65-8651-0a10e691cd10" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.024995] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.025339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.025339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.025441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.025530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.025629] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be updated. [ 791.054970] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.054970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.054970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.054970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.054970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.067446] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: IN_PROGRESS for 2s [ 791.218936] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.219161] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.219293] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.219682] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.219955] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.220175] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.220297] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.220514] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.220657] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.220861] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.220972] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.221093] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.221203] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.221309] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.221411] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.221719] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.233341] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.233467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.233538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.235059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.235059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.235059] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.235059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.235059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.235059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.235059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.235059] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 already deleted. [ 791.235059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.240429] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.240679] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.240754] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.240870] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.241162] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-f7677335-149a-49b2-bba7-246abacca3a2 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.241321] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.241435] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.241724] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.241857] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7677335-149a-49b2-bba7-246abacca3a2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.744455] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.746576] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port f7677335-149a-49b2-bba7-246abacca3a2 not found, creating... [ 791.746576] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.746576] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.747316] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.747316] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.747316] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.747316] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.747543] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.747594] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: f7677335-149a-49b2-bba7-246abacca3a2 is going to be created. [ 791.771316] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.771624] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.771758] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.772065] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.772308] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.772533] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.310271] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 in Status: SUCCESS [ 792.310619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.463212] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 792.463504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.463688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.463963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.464172] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.464335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.464410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.464587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.464690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.464793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.464894] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.469989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.469989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.469989] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.469989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.471334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.471594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.471694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.471798] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.867560] env[69219]: INFO networking_nsxv3.common.synchronization [req-1e0c609e-c1f4-4edb-93a4-dce13c1c69ff req-352876ea-dd41-4468-8389-e435b87d4838 tempest-ServersAdminNegativeTestJSON-713106145 tempest-ServersAdminNegativeTestJSON-713106145-project-member] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 792.868253] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGHEST for action security_group_members [ 792.868650] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.870140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.870276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.870530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.870761] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.871032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.871180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.871393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.871986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.871986] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.881397] env[69219]: INFO networking_nsxv3.common.synchronization [req-d6d96c12-6390-49b3-b6d0-af7b91d82f82 req-aaa30883-ad31-4674-b0b4-f46d22c18ccb service nova] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_rules [ 792.881559] env[69219]: INFO networking_nsxv3.common.synchronization [req-d6d96c12-6390-49b3-b6d0-af7b91d82f82 req-aaa30883-ad31-4674-b0b4-f46d22c18ccb service nova] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 792.881701] env[69219]: INFO networking_nsxv3.common.synchronization [req-d6d96c12-6390-49b3-b6d0-af7b91d82f82 req-aaa30883-ad31-4674-b0b4-f46d22c18ccb service nova] Enqueued Resource ID: f7677335-149a-49b2-bba7-246abacca3a2 with Priority: HIGHEST for action port [ 792.882522] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_rules [ 792.882522] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 792.882522] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7677335-149a-49b2-bba7-246abacca3a2 with Priority: HIGHEST for action port [ 792.883099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.884665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.884736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.885057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.885863] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.886802] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.888032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.888159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.892044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.892044] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.892044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7677335-149a-49b2-bba7-246abacca3a2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.892044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.892044] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7677335-149a-49b2-bba7-246abacca3a2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.969469] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.976761] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.078778] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: SUCCESS [ 793.079123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.079343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.079620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.079852] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.080071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.080180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.080304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.080413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.080524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.080663] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.248375] env[69219]: INFO networking_nsxv3.common.synchronization [req-59139227-9525-4046-bc7b-5e84fcd50fc4 req-76e0b644-88f5-48ff-8663-57f3efc9e0e0 tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 793.249050] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 793.249392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.249510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.378334] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.378636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.378636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.378784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.378876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.379153] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.379275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.379339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.379486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.379560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.379644] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be updated. [ 793.396750] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.396874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.397094] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.400355] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7677335-149a-49b2-bba7-246abacca3a2 with status ACTIVE [ 793.400532] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.400641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.400707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.400908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.400961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.401140] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.401277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.401588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.401588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.401588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.401736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.401823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.401879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.402018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.402092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.402174] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7677335-149a-49b2-bba7-246abacca3a2 is going to be updated. [ 793.414752] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.414874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.414967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.415154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.415283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.423434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.423562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.423621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.423798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.424278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.424482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7677335-149a-49b2-bba7-246abacca3a2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.425151] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: IN_PROGRESS for 2s [ 793.475506] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec5e6bce-48d8-4a26-8add-53a08d2b2afe: rpc.has_security_group_logging(os_id): False [ 793.479279] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.496427] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.496588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.496681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.496881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.496981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.497240] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.497342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.497408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.497560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.497638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.497724] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be updated. [ 793.508231] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.508419] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.508546] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.508793] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.509114] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.509281] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.509410] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.509630] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.509774] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.509982] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.510206] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.510321] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.510431] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.510540] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.510647] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.510777] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.539475] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.539645] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 793.539788] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.539982] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.540324] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-7e9bf5e0-5a58-4602-bf49-3963d902d427 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.540513] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.540636] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.540947] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.541103] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e9bf5e0-5a58-4602-bf49-3963d902d427',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.583089] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.583337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.583444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.583692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.583870] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.583971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.584054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.584508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.584508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.584508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.584761] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.584761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.584761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.584923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.585045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.585143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.585202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.585383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.585462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.585570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.585650] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.591895] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.592028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.592104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.592267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.592404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.643561] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 793.899143] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.983985] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.983985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.983985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.983985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.983985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.983985] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be updated. [ 794.011251] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.011459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.011534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.011752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.011920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.020219] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 794.043915] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.044198] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.044344] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.044648] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.044813] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.046223] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 7e9bf5e0-5a58-4602-bf49-3963d902d427 not found, creating... [ 794.046223] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.046223] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.046223] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.046223] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.046443] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.046655] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.046914] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.047271] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.047759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.047977] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.048203] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 7e9bf5e0-5a58-4602-bf49-3963d902d427 is going to be created. [ 794.074886] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.074886] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.074886] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.075201] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.075803] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.075803] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.089906] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04ba1205-02a7-4968-99ca-25d19305f8e9: rpc.has_security_group_logging(os_id): False [ 794.107959] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.109067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.109067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.109067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.109067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.109067] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.109067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.109466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.109466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.109466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.109553] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.109597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.109753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.109806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.109852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.110087] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.110226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.110283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.110427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.110503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.110612] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be updated. [ 794.213460] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.213460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.213460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.213757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.213890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.229635] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: IN_PROGRESS for 2s [ 794.401858] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.402236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.402236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.403014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.403014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.403014] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be created. [ 794.426849] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.427093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.427169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.427380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.427580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.438040] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: UNINITIALIZED for 2s [ 794.777847] env[69219]: INFO networking_nsxv3.common.synchronization [req-59139227-9525-4046-bc7b-5e84fcd50fc4 req-b9d0b579-a962-491c-b343-d3a6c42d9759 service nova] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_rules [ 794.777847] env[69219]: INFO networking_nsxv3.common.synchronization [req-59139227-9525-4046-bc7b-5e84fcd50fc4 req-b9d0b579-a962-491c-b343-d3a6c42d9759 service nova] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 794.777847] env[69219]: INFO networking_nsxv3.common.synchronization [req-59139227-9525-4046-bc7b-5e84fcd50fc4 req-b9d0b579-a962-491c-b343-d3a6c42d9759 service nova] Enqueued Resource ID: 7e9bf5e0-5a58-4602-bf49-3963d902d427 with Priority: HIGHEST for action port [ 794.777847] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_rules [ 794.777847] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 794.777847] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9bf5e0-5a58-4602-bf49-3963d902d427 with Priority: HIGHEST for action port [ 794.778675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.778854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.783258] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.783258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.783258] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e9bf5e0-5a58-4602-bf49-3963d902d427 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.783258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.783258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.783258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.783258] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e9bf5e0-5a58-4602-bf49-3963d902d427',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.286649] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e9bf5e0-5a58-4602-bf49-3963d902d427 with status ACTIVE [ 795.286649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.286649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.286649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.286649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.287034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.287034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.287153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.287287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.288391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.288391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.288391] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.288391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.288391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.288391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.288391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.288770] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e9bf5e0-5a58-4602-bf49-3963d902d427 is going to be updated. [ 795.314639] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.314764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.314852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.315136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.315286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.315666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e9bf5e0-5a58-4602-bf49-3963d902d427" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.446935] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 in Status: SUCCESS [ 795.446935] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 deletion is rescheduled due to dependency. [ 795.446935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.676226] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 795.676744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.676744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.677064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.677158] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.864983] env[69219]: INFO networking_nsxv3.common.synchronization [req-6e3d505f-89b2-4603-a037-8d6d36ac9d61 req-3d1bc86f-76d9-4f7d-8349-d6a6068d3c86 tempest-AttachInterfacesUnderV243Test-1978706118 tempest-AttachInterfacesUnderV243Test-1978706118-project-member] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 795.868632] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGHEST for action security_group_members [ 795.872090] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.872090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.031667] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 796.031914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.032106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.032353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.032556] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.032675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.032740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.032900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.032982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.033113] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.179831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.179989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.243740] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: SUCCESS [ 796.246036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.447122] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 796.447567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.447567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.447864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.447946] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.448042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.448083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.448254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.448339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.448439] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.539410] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.541501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.541589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.541879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.542147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.542411] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.542523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.542586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.542757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.542865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.542956] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be updated. [ 796.572300] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.572300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.572300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.572300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.572300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.582176] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 796.599022] env[69219]: INFO networking_nsxv3.common.synchronization [req-892167f5-3748-4b59-867f-446bab64c148 req-20dbe7b3-6558-4f4e-b6c3-f2af85d78f6e tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 796.599586] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 796.600155] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.600406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.600406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.600588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.604019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.604019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.604019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.604019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.604019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.604019] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.950511] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.110127] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.110389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.110389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.110581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.110674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.110871] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.111011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.111085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.111181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.111257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.111370] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 797.138019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.138019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.138019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.138019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.138019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.153143] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 797.456877] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.484280] env[69219]: INFO networking_nsxv3.common.synchronization [req-6468cba6-d15e-41f2-ae3b-c23419c020b4 req-d6684fc9-cbc1-425d-abc7-fd646f09a86b tempest-DeleteServersAdminTestJSON-1802826885 tempest-DeleteServersAdminTestJSON-1802826885-project-member] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 797.484874] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 797.485283] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.485463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.485566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.485807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.486026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.486226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.486328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.486504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.486641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.486771] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.865897] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.871021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.871021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.871021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.871021] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.871021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.871021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.871021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.871021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.871021] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.871021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.871021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.871021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.871021] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.871021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.871021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.894956] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.894956] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.894956] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.894956] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.894956] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-6089470e-70d0-4e3f-8161-3079675130df taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.894956] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.894956] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.894956] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.894956] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6089470e-70d0-4e3f-8161-3079675130df',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.961384] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.961575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.961654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.961913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.962019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.962134] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be updated. [ 797.989194] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.989744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.989744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.989859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.989935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.990196] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.990328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.990392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.990580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.990680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.990769] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be updated. [ 797.992756] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.992879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.992948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.993140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.993904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.012220] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: IN_PROGRESS for 2s [ 798.030525] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.030733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.030812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.031073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.031228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.058334] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: IN_PROGRESS for 2s [ 798.396868] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.397422] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.397422] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.397548] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.397667] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.398363] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 6089470e-70d0-4e3f-8161-3079675130df not found, creating... [ 798.398363] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.398363] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.398363] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.398604] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.398719] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.398996] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.399169] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.399282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.400035] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.400035] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.400035] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 6089470e-70d0-4e3f-8161-3079675130df is going to be created. [ 798.425360] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.427219] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.427382] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.427712] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.427943] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.428199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.597087] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 798.597087] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe deletion is rescheduled due to dependency. [ 798.597087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.597087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.597793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.597793] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.597793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.598140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.598483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.598632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.598802] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.104180] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.104458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.104458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.104653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.104837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.104945] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.105064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.105127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.105279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.105369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.105459] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be updated. [ 799.131241] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.131401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.131511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.131776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.132168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.145165] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 799.164831] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 799.164831] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 deletion is rescheduled due to dependency. [ 799.164831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.280111] env[69219]: INFO networking_nsxv3.common.synchronization [req-6468cba6-d15e-41f2-ae3b-c23419c020b4 req-9292945e-4f85-4d45-97d2-24d156dbab23 service nova] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_rules [ 799.280111] env[69219]: INFO networking_nsxv3.common.synchronization [req-6468cba6-d15e-41f2-ae3b-c23419c020b4 req-9292945e-4f85-4d45-97d2-24d156dbab23 service nova] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 799.280111] env[69219]: INFO networking_nsxv3.common.synchronization [req-6468cba6-d15e-41f2-ae3b-c23419c020b4 req-9292945e-4f85-4d45-97d2-24d156dbab23 service nova] Enqueued Resource ID: 6089470e-70d0-4e3f-8161-3079675130df with Priority: HIGHEST for action port [ 799.280111] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_rules [ 799.280111] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 799.280111] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6089470e-70d0-4e3f-8161-3079675130df with Priority: HIGHEST for action port [ 799.280603] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.280706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.280706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.281102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.281102] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.282275] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.282432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.282635] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-6089470e-70d0-4e3f-8161-3079675130df taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.282810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.285310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.285310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.285310] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6089470e-70d0-4e3f-8161-3079675130df',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.789029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.789029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6089470e-70d0-4e3f-8161-3079675130df with status ACTIVE [ 799.789029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.789029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.789029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.789029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.790065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.790065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.790065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.790065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.790065] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6089470e-70d0-4e3f-8161-3079675130df is going to be updated. [ 799.811146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.811146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.811146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.811146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.811146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.811146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6089470e-70d0-4e3f-8161-3079675130df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.022121] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 800.022368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.022531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.022742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.022922] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.023059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.023127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.023278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.023362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.023446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.023542] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.024362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.024522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.024675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.025813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.025941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.026153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.026245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.026337] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.068825] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: SUCCESS [ 800.068825] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 deletion is rescheduled due to dependency. [ 800.068825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.068825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.068825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.068825] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.068825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.068825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.068825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.068825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.068825] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.529904] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.529904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.529904] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.572617] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.824396] env[69219]: INFO networking_nsxv3.common.synchronization [req-27839d9b-0296-4b78-88d5-28482ccfb531 req-4c65e02f-5f29-462a-aa36-6b5ed0951e16 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_members [ 800.824396] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGHEST for action security_group_members [ 800.827060] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.827060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.827060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.827060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.827060] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.827060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.827060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.827060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.827060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.827060] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.032488] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.078147] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.157909] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 801.157909] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe deletion is rescheduled due to dependency. [ 801.158272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.158272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.158343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.158533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.158648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.158715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.158860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.158941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.159055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.159156] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.330171] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.331026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.331026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.331026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.331026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.331026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.331026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.331484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.331484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.331484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.331484] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c is going to be updated. [ 801.368958] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.368958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.368958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.368958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.368958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.377263] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c in Status: IN_PROGRESS for 2s [ 801.537481] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.537696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.537754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.538136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.538136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.538243] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be updated. [ 801.575953] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.576149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.576210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.576521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.576650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.587702] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.587702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.587702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.587702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.587702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.587702] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be updated. [ 801.589296] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: IN_PROGRESS for 2s [ 801.627767] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.627948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.628048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.628260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.628415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.642605] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: IN_PROGRESS for 2s [ 801.664168] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.167840] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec5e6bce-48d8-4a26-8add-53a08d2b2afe: rpc.has_security_group_logging(os_id): False [ 802.192856] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.193102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.193192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.193519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.193519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.193680] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.193777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.193839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.193991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.194089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.194177] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be updated. [ 802.266915] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.266915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.266915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.266915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.266915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.285780] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: IN_PROGRESS for 2s [ 802.575138] env[69219]: INFO networking_nsxv3.common.synchronization [req-669a3d3d-88bd-4212-ac20-2c9c82a4d12f req-a1e8e717-53d3-4e2f-a897-290a86d9fce7 tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 802.575138] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 802.575138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.575138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.575138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.575830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.576041] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.576162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.576226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.576390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.576480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.576617] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.078714] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.078905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.078948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.079316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.079416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.079623] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.079727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.079883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.079963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.080041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.080160] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be updated. [ 803.110370] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.110624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.110624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.110807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.110954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.119767] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 803.387676] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c in Status: SUCCESS [ 803.388076] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c deletion is rescheduled due to dependency. [ 803.388076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.561097] env[69219]: INFO networking_nsxv3.common.synchronization [req-5335feb5-3879-4dd2-b27f-103e861b38ac req-0d835ecb-9e4e-421c-9695-6e1ff58fd3fb tempest-ListImageFiltersTestJSON-2006389702 tempest-ListImageFiltersTestJSON-2006389702-project-member] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 803.561661] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 803.561973] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.569240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.569351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.569716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.569963] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.570130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.570216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.570427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.570537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.570644] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.609383] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 803.609608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.609781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.610011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.610219] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.610336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.610402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.610558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.610642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.610727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.610877] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.610989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.611044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.611197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.611342] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.611436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.611497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.611636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.611711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.611790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.611878] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.657374] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: SUCCESS [ 803.657374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.657545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.657608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.657798] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.657917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.657976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.658143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.658229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.658309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.658403] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.891818] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.892130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.892293] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.893018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.893466] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.893668] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.893796] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.894089] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.894303] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.896413] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.896413] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.896413] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.896413] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.896413] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.896413] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.896413] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.918330] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.918558] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.918742] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.919041] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.919393] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.919587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.919731] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.920109] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.920286] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f75fcf7-f3b8-4b4b-87de-6d94a055e350',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.072664] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.072833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.072895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.073155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.073254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.073486] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.073597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.073659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.073819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.073898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.073983] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c already deleted. [ 804.074079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.116991] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b8eea57-ce57-4940-9c1a-cd39d18803e2: rpc.has_security_group_logging(os_id): False [ 804.135045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.135045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.135045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.135045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.135669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.135669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.135669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.135669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.135669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.135817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.135817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.135873] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be created. [ 804.162380] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.162543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.162664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.162857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.165545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.165545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.165545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.165545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.165545] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.204854] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.207045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.207045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.207045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.207045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.216288] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: IN_PROGRESS for 2s [ 804.327932] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe in Status: SUCCESS [ 804.328842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.425025] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.425025] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 3f75fcf7-f3b8-4b4b-87de-6d94a055e350 not found, creating... [ 804.425025] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.425025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.425656] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.425656] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.425656] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.426538] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.427980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.427980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 3f75fcf7-f3b8-4b4b-87de-6d94a055e350 is going to be created. [ 804.451859] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.451859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.451859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.451859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.451859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.451859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.666675] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9153ebdf-4f47-4818-bdd9-2172ee701c16: rpc.has_security_group_logging(os_id): False [ 804.684755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.684964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.685067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.685287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.685385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.685640] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.685762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.685825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.685977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.686083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.686309] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.686412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.686474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.686615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.686704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.686923] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.687294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.687431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.687622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.687751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.687875] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be updated. [ 804.761770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.761770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.761770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.761770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.761770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.774425] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: IN_PROGRESS for 2s [ 805.130772] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 805.131519] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 deletion is rescheduled due to dependency. [ 805.131519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.317815] env[69219]: INFO networking_nsxv3.common.synchronization [req-e0ffd6c7-d55f-4a7b-a539-5695a020e83d req-6f201252-b7e9-40e0-9a4a-2b219c697a60 tempest-FloatingIPsAssociationTestJSON-828494427 tempest-FloatingIPsAssociationTestJSON-828494427-project-member] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 805.318677] env[69219]: INFO networking_nsxv3.common.synchronization [req-5335feb5-3879-4dd2-b27f-103e861b38ac req-1a850605-bd8c-4531-a52f-b27acaf4711a service nova] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_rules [ 805.318976] env[69219]: INFO networking_nsxv3.common.synchronization [req-5335feb5-3879-4dd2-b27f-103e861b38ac req-1a850605-bd8c-4531-a52f-b27acaf4711a service nova] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 805.319656] env[69219]: INFO networking_nsxv3.common.synchronization [req-5335feb5-3879-4dd2-b27f-103e861b38ac req-1a850605-bd8c-4531-a52f-b27acaf4711a service nova] Enqueued Resource ID: 3f75fcf7-f3b8-4b4b-87de-6d94a055e350 with Priority: HIGHEST for action port [ 805.323502] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 805.323502] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 805.323502] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_rules [ 805.323502] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f75fcf7-f3b8-4b4b-87de-6d94a055e350 with Priority: HIGHEST for action port [ 805.323502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.323502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.323502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.324144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.324434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.324657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.324820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.325083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.325284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.325465] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.326534] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.332643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.332643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.332643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.332643] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.332643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.332643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.332643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.332643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.332643] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.335246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.335246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.335246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.335246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.335246] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.337033] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.337033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.337033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.337393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.337456] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f75fcf7-f3b8-4b4b-87de-6d94a055e350',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.842110] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.842526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.842526] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.843411] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.851031] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f75fcf7-f3b8-4b4b-87de-6d94a055e350 with status ACTIVE [ 805.851031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.851031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.851031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.851031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.851031] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f75fcf7-f3b8-4b4b-87de-6d94a055e350 is going to be updated. [ 805.874121] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.874121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.874121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.874121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.874121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.874121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f75fcf7-f3b8-4b4b-87de-6d94a055e350" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.231125] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 806.232732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.232732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.232732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.232732] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.347121] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.349616] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.559697] env[69219]: INFO networking_nsxv3.common.synchronization [req-278d8269-6070-4730-9be3-2b84388a6f30 req-068e9f31-ef95-414d-bd39-0a4a000ac2aa tempest-ListImageFiltersTestJSON-2006389702 tempest-ListImageFiltersTestJSON-2006389702-project-member] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 806.560384] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 806.560670] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.560772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.738730] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.739929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.740156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.740641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.740641] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.740733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.740771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.741233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.741341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.742498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.742498] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.791126] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: SUCCESS [ 806.791350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.849632] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.849948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.849948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.850257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.850390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.850521] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be created. [ 806.853338] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.853580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.853694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.854858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.855014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.855150] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be updated. [ 806.893883] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.894117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.895641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.895641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.895641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.899961] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.900157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.900225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.900386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.900538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.911377] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: IN_PROGRESS for 2s [ 806.912013] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: UNINITIALIZED for 2s [ 806.944804] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.944999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.945142] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.945419] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.945758] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.945925] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.946055] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.946924] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.947189] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.947429] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.947553] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.947669] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.947782] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.947896] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.948017] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.948155] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.967560] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.967749] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.967867] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.968053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.970967] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.970967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.970967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.970967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.970967] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14dfc654-7b7a-4028-9da7-a1650bf6bc7c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.246384] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.246384] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.246384] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.246384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.247113] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.247113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.247113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.247113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.247113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.247113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.247113] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.474706] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.474949] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.475094] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.475385] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.475526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.475677] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 14dfc654-7b7a-4028-9da7-a1650bf6bc7c not found, creating... [ 807.475973] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.476843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.476843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.476843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.476843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.476843] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.477439] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.477439] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.477439] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.477439] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.477635] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 14dfc654-7b7a-4028-9da7-a1650bf6bc7c is going to be created. [ 807.498723] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.498943] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.499250] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.499452] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.499678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.499907] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.749265] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b8eea57-ce57-4940-9c1a-cd39d18803e2: rpc.has_security_group_logging(os_id): False [ 807.771035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.771206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.771271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.771562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.771662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.771865] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.771979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.772068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.772230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.772319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.772546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.772656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.772723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.772839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.772905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.773119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.773229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.773282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.773425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.773501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.773585] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be updated. [ 807.847388] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.847582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.847670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.847908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.848090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.864052] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: IN_PROGRESS for 2s [ 808.551890] env[69219]: INFO networking_nsxv3.common.synchronization [req-278d8269-6070-4730-9be3-2b84388a6f30 req-98ddcc47-ca3b-4e9a-a173-0f4f13716829 service nova] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_rules [ 808.552098] env[69219]: INFO networking_nsxv3.common.synchronization [req-278d8269-6070-4730-9be3-2b84388a6f30 req-98ddcc47-ca3b-4e9a-a173-0f4f13716829 service nova] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 808.552241] env[69219]: INFO networking_nsxv3.common.synchronization [req-278d8269-6070-4730-9be3-2b84388a6f30 req-98ddcc47-ca3b-4e9a-a173-0f4f13716829 service nova] Enqueued Resource ID: 14dfc654-7b7a-4028-9da7-a1650bf6bc7c with Priority: HIGHEST for action port [ 808.552469] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_rules [ 808.552612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 808.552708] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14dfc654-7b7a-4028-9da7-a1650bf6bc7c with Priority: HIGHEST for action port [ 808.553766] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.553865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.554066] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.554149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.554323] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.554426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.554476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.554662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.554736] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14dfc654-7b7a-4028-9da7-a1650bf6bc7c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.926145] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 808.926450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.926845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.926845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.927079] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.927452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.927452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.927551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.927601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.927671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.927782] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.929448] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: SUCCESS [ 808.929643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.929798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.929979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.930206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.930326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.930392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.930551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.930631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.930727] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.056757] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14dfc654-7b7a-4028-9da7-a1650bf6bc7c with status ACTIVE [ 809.057100] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.057250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.057315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.057538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.057638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.057824] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.057993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.057993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.058154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.058250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.058495] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.058634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.058702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.058885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.058963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.059173] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14dfc654-7b7a-4028-9da7-a1650bf6bc7c is going to be updated. [ 809.084795] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.084968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.085055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.085339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.085489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.085795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14dfc654-7b7a-4028-9da7-a1650bf6bc7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.433065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.433423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.433705] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.876556] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 809.876781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.936352] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.441952] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.441952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.441952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.441952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.441952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.441952] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be updated. [ 810.471924] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.471924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.471924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.471924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.471924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.480986] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 2s [ 811.259339] env[69219]: INFO networking_nsxv3.common.synchronization [None req-ac541336-8814-4c75-9345-73c35052c102 None None] Enqueued Resource ID: 689a5ebc-6bb2-4bdf-9593-73fe10850380 with Priority: HIGHEST for action port [ 811.260083] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 689a5ebc-6bb2-4bdf-9593-73fe10850380 with Priority: HIGHEST for action port [ 811.260083] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-689a5ebc-6bb2-4bdf-9593-73fe10850380 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.260351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-689a5ebc-6bb2-4bdf-9593-73fe10850380" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.260351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-689a5ebc-6bb2-4bdf-9593-73fe10850380" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.260509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-689a5ebc-6bb2-4bdf-9593-73fe10850380" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.260591] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('689a5ebc-6bb2-4bdf-9593-73fe10850380',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.762652] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 689a5ebc-6bb2-4bdf-9593-73fe10850380 [ 811.763903] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.763903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.763903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.763903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.763903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.763903] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:689a5ebc-6bb2-4bdf-9593-73fe10850380 already deleted. [ 811.763903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-689a5ebc-6bb2-4bdf-9593-73fe10850380" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.495202] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 812.495202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.495202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.497992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.497992] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.497992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.497992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.497992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.497992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.497992] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.002196] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.284733] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f08db654-cc0a-4e5d-bcc0-9ec1f4167da1 None None] Enqueued Resource ID: 634d3681-4099-4a68-aeed-d1b69677a541 with Priority: HIGHEST for action port [ 813.284845] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 634d3681-4099-4a68-aeed-d1b69677a541 with Priority: HIGHEST for action port [ 813.285434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-634d3681-4099-4a68-aeed-d1b69677a541 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.285520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-634d3681-4099-4a68-aeed-d1b69677a541" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.285588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-634d3681-4099-4a68-aeed-d1b69677a541" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.285864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-634d3681-4099-4a68-aeed-d1b69677a541" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.285950] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('634d3681-4099-4a68-aeed-d1b69677a541',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.505117] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.789116] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 634d3681-4099-4a68-aeed-d1b69677a541 [ 813.789370] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.789502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.789577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.789847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.790016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.790062] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:634d3681-4099-4a68-aeed-d1b69677a541 already deleted. [ 813.790144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-634d3681-4099-4a68-aeed-d1b69677a541" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.961146] env[69219]: INFO networking_nsxv3.common.synchronization [req-6abe7cd5-8105-4f09-bf62-6a486a86eeb9 req-0bec80a4-b7b8-49c0-8b18-d6ed52837520 tempest-DeleteServersAdminTestJSON-1802826885 tempest-DeleteServersAdminTestJSON-1802826885-project-member] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 813.961146] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGHEST for action security_group_members [ 813.961146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.961317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.961317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.961452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.961597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.961738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.961807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.961956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.962050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.962150] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.008137] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.008342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.008417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.008646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.008754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.008842] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be updated. [ 814.040960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.040960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.040960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.040960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.040960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.049986] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 2s [ 814.464365] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.464535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.464605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.464831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.464926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.465605] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.468046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.468046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.468046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.468046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.468046] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be updated. [ 814.494636] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.494788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.494856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.495084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.495263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.505780] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: IN_PROGRESS for 2s [ 816.065288] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 816.065672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.065672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.065884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.066095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.066217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.066285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.066441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.066600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.066600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.066749] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.066840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.066901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.067113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.067235] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.067329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.067391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.067597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.067680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.067763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.067851] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.516234] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: IN_PROGRESS for 4s [ 816.571051] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c: rpc.has_security_group_logging(os_id): False [ 816.591193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.591193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.591193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.591193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.591789] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.591789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.591789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.591789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.591789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.591789] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be created. [ 816.657809] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.657988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.658103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.658353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.658566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.669612] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 2s [ 818.536934] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 in Status: SUCCESS [ 818.536934] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 deletion is rescheduled due to dependency. [ 818.536934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.685392] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 818.685392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.685392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.685392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.685392] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.962159] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 818.962307] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 819.188197] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.188351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.188423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.188650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.188822] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.188929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.188990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.189313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.189396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.189490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.189646] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.692507] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.692904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.692904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.693018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.693210] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.693320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.693385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.693541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.693628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.693716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.693864] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.693954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.694024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.694170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.694309] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.694399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.694458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.694596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.694676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.694754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.694846] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.197028] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c: rpc.has_security_group_logging(os_id): False [ 820.214047] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.214178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.214178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.214483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.214483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.214694] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.214793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.214854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.215008] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.215090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.215273] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.215367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.215435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.215562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.215638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.215835] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.215927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.215987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.216210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.216293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.216382] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be updated. [ 820.289477] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.289658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.289729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.289977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.290186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.302044] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 2s [ 822.316565] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 822.316925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.815643] env[69219]: INFO networking_nsxv3.common.synchronization [req-052a7c54-e2ca-4d1a-be53-fd2a4f3d4175 req-48ddd41f-3195-4356-842a-a5caeb6028d2 tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 823.816560] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 823.816980] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.817222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.817310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.817588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.817792] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.817950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.818064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.818247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.818346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.818498] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.168408] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.168676] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.168811] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.169413] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.169848] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.170118] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.170311] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.170662] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.170900] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.171206] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.171375] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.171532] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.171734] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.171825] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.171997] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.172242] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.197222] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.197380] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 824.197746] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.197746] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.197953] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-5df7c7e8-c99d-44d2-9b97-7f6805cca563 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.198129] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.198254] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.199039] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.199039] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5df7c7e8-c99d-44d2-9b97-7f6805cca563',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.320791] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.322193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.322193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.322193] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 824.357852] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.357852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.357852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.357852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.357852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.365045] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 824.703930] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.703930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.703930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.703930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.703930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.703930] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 5df7c7e8-c99d-44d2-9b97-7f6805cca563 not found, creating... [ 824.703930] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.704333] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.704333] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.704333] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.704516] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.704882] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.705108] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.705270] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.705523] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.705706] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.705874] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 5df7c7e8-c99d-44d2-9b97-7f6805cca563 is going to be created. [ 824.726135] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.726356] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.726487] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.726774] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.726999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.727289] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.667689] env[69219]: INFO networking_nsxv3.common.synchronization [req-052a7c54-e2ca-4d1a-be53-fd2a4f3d4175 req-e451ebb4-125a-44e4-afa5-3afbbf7fa4b2 service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 825.667938] env[69219]: INFO networking_nsxv3.common.synchronization [req-052a7c54-e2ca-4d1a-be53-fd2a4f3d4175 req-e451ebb4-125a-44e4-afa5-3afbbf7fa4b2 service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 825.668030] env[69219]: INFO networking_nsxv3.common.synchronization [req-052a7c54-e2ca-4d1a-be53-fd2a4f3d4175 req-e451ebb4-125a-44e4-afa5-3afbbf7fa4b2 service nova] Enqueued Resource ID: 5df7c7e8-c99d-44d2-9b97-7f6805cca563 with Priority: HIGHEST for action port [ 825.668594] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 825.668739] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 825.668838] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5df7c7e8-c99d-44d2-9b97-7f6805cca563 with Priority: HIGHEST for action port [ 825.671186] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.671345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.671430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.671707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.671742] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.673841] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.673941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.674225] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-5df7c7e8-c99d-44d2-9b97-7f6805cca563 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.674350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.674350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.674629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.674768] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5df7c7e8-c99d-44d2-9b97-7f6805cca563',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.174710] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.174913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.182280] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5df7c7e8-c99d-44d2-9b97-7f6805cca563 with status ACTIVE [ 826.182597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.182670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.182714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.182949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.183096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.183264] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.183656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.183656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.183656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.183887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.183887] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.183982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.183982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.184142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.184255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.184395] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5df7c7e8-c99d-44d2-9b97-7f6805cca563 is going to be updated. [ 826.207282] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.207477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.207554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.207718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.207851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.208041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5df7c7e8-c99d-44d2-9b97-7f6805cca563" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.374023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 826.374224] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d deletion is rescheduled due to dependency. [ 826.374351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.374499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.374717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.374906] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.375068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.375181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.375394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.375486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.375586] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.878811] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.188038] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:0 completed [ 827.188196] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:1 started [ 827.381526] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.879938] env[69219]: INFO networking_nsxv3.common.synchronization [req-e09fa818-35c4-4063-be4a-61f7a91ade56 req-329c8af5-ba83-46e2-ba6d-2c480148fec9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 827.880595] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 827.880931] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.881164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.881282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.881594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.881818] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.881967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.882077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.882288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.882427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.882551] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.883760] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.883913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.883988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.884175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.884270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.884371] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 827.913055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.913325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.913325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.913470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.913620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.922816] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 828.172821] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-587 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.173036] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.173166] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.173494] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.173751] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.173913] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.174042] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.174267] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.174413] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.174621] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.174725] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.174835] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.174944] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.175072] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.175186] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.175321] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.195708] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.195708] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.195708] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.195708] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.195708] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-effd0fbc-96ff-4722-96eb-50c6d7d02081 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.195708] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.195708] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.195708] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.196192] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effd0fbc-96ff-4722-96eb-50c6d7d02081',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.386860] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.387101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.387161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.387410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.387508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.387710] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.387813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.387875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.388031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.388109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.388192] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd already deleted. [ 828.388276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.698194] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.698443] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.698601] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.698917] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.699192] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.699415] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port effd0fbc-96ff-4722-96eb-50c6d7d02081 not found, creating... [ 828.699692] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.699856] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.699967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.700245] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.700413] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.700658] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.700824] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.700927] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.701234] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.701284] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.701413] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 is going to be created. [ 828.723106] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.723343] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.723582] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.723745] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.723967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.724767] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.436263] env[69219]: INFO networking_nsxv3.common.synchronization [req-e09fa818-35c4-4063-be4a-61f7a91ade56 req-2ad96ea4-dc9f-448d-b223-803cf2317f77 service nova] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 829.436263] env[69219]: INFO networking_nsxv3.common.synchronization [req-e09fa818-35c4-4063-be4a-61f7a91ade56 req-2ad96ea4-dc9f-448d-b223-803cf2317f77 service nova] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 829.436263] env[69219]: INFO networking_nsxv3.common.synchronization [req-e09fa818-35c4-4063-be4a-61f7a91ade56 req-2ad96ea4-dc9f-448d-b223-803cf2317f77 service nova] Enqueued Resource ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 with Priority: HIGHEST for action port [ 829.436263] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 829.436263] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 829.436263] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 with Priority: HIGHEST for action port [ 829.436263] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.436263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.436897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.436897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.436968] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.439161] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.439161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.439161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.439161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.443882] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.444015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.444086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.444296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.444364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.444458] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.446160] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-effd0fbc-96ff-4722-96eb-50c6d7d02081 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.446272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.446369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.446497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.446586] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effd0fbc-96ff-4722-96eb-50c6d7d02081',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.937436] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 829.937657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.938342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.938495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.938961] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.938961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.938961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.939202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.939202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.939609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.939609] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.948905] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.949104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.949261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.949441] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port effd0fbc-96ff-4722-96eb-50c6d7d02081 with status ACTIVE [ 829.949859] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.949859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.949859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.950072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.950072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.950261] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.950363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.950409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.950569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.950650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.951140] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.951140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.951140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.951480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.951556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.951642] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 is going to be updated. [ 829.979091] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.979091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.979091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.979091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.979091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.979091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.441656] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.442052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.442052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.442264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.442492] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.442617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.442726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.442984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.443129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.443247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.443434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.443609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.443662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.443813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.443979] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.444118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.444223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.444436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.444484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.444567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.444668] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.455666] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.949085] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df327ac5-73cd-478c-b19b-3849894e070d: rpc.has_security_group_logging(os_id): False [ 830.957728] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.957893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.957961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.958207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.958912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958912] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be created. [ 830.971173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.971173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.971391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.971391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.971836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.971836] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.971836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.971836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.972046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.972090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.972247] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.972341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.972392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.972531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.972603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.972789] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.972883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.972942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.973089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.973162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.973244] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 830.985778] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.985940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.986030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.986215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.986378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.996393] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: UNINITIALIZED for 2s [ 831.038412] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.038412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.038412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.038412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.038412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.055850] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 833.008670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.008670] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.008670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.008670] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.068369] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 833.068369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.351332] env[69219]: INFO networking_nsxv3.common.synchronization [req-47ac21bd-96de-438d-a1bb-7e2d5551436a req-98bfeb57-fde4-4378-a740-236ed1432921 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 833.351332] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 833.352521] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.353101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.353435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.353962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.354309] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.355041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.355227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.355526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.355853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.358194] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.515065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.515242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.515309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.515559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.515738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.515860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.515934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.516123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.516210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.516296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.516445] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.516529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.516587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.516751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.516886] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.516983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.517038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.517231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.517308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.517807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.517807] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.860562] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.860732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.860790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.862550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.862550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.862550] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.862550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.862550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.862550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.862550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.862550] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 833.897445] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.897445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.897445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.897912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.899732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.908318] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 833.943148] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-70 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.943341] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.943571] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.947014] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.947014] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.947014] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.947014] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.947014] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.947014] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.947014] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.947014] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.947406] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.947406] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.947480] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.947580] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.947716] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.968111] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.968379] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.968452] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.968606] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.969154] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-f695b5b2-1111-4adc-ab08-434bc786dc79 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.969386] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.975122] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.975122] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.975122] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f695b5b2-1111-4adc-ab08-434bc786dc79',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.020465] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd: rpc.has_security_group_logging(os_id): False [ 834.040389] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.040769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.040973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.042330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.042428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.042660] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.042762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.042824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.042986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.043085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.043297] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.043391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.043451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.043590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.043666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.043850] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.043957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.044026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.044204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.044267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.044327] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be created. [ 834.113408] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.113611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.115058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.115058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.115058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.125731] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 834.237606] env[69219]: INFO networking_nsxv3.common.synchronization [None req-bca41b8f-5c5e-427a-9e4a-bfc3642be158 None None] Enqueued Resource ID: 9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d with Priority: HIGHEST for action port [ 834.237606] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d with Priority: HIGHEST for action port [ 834.237606] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.237606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.237606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.238438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.239120] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.481789] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.481789] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.481789] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.482278] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.482586] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.482877] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port f695b5b2-1111-4adc-ab08-434bc786dc79 not found, creating... [ 834.484979] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.484979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.484979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.484979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.484979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.484979] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.484979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.484979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.485784] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.486268] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.486543] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: f695b5b2-1111-4adc-ab08-434bc786dc79 is going to be created. [ 834.511337] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.511337] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.511337] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.511337] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.511337] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.511337] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.745430] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d [ 834.745709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.745902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.745963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.746371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.746371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.746371] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d already deleted. [ 834.746606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ddcdf09-74a8-4741-86eb-2e5fc9cb3d7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.505193] env[69219]: INFO networking_nsxv3.common.synchronization [req-a781e214-5087-4a3b-bbcb-ba9d14bf215c req-cc41d8ba-e619-4c02-b588-2cfca8a19d01 tempest-ImagesOneServerTestJSON-1012517002 tempest-ImagesOneServerTestJSON-1012517002-project-member] Enqueued Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_members [ 835.505828] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGHEST for action security_group_members [ 835.508269] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.508269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.508269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.508269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.508269] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.508548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.508548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.508735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.508890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.509084] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.565743] env[69219]: INFO networking_nsxv3.common.synchronization [req-47ac21bd-96de-438d-a1bb-7e2d5551436a req-51f7f1f6-4f92-408f-9267-97901b0f56ea service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 835.565959] env[69219]: INFO networking_nsxv3.common.synchronization [req-47ac21bd-96de-438d-a1bb-7e2d5551436a req-51f7f1f6-4f92-408f-9267-97901b0f56ea service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 835.566368] env[69219]: INFO networking_nsxv3.common.synchronization [req-47ac21bd-96de-438d-a1bb-7e2d5551436a req-51f7f1f6-4f92-408f-9267-97901b0f56ea service nova] Enqueued Resource ID: f695b5b2-1111-4adc-ab08-434bc786dc79 with Priority: HIGHEST for action port [ 835.566712] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 835.566887] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 835.566973] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f695b5b2-1111-4adc-ab08-434bc786dc79 with Priority: HIGHEST for action port [ 835.567995] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.568216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.569357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.569613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.569737] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.571467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.571467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.571467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f695b5b2-1111-4adc-ab08-434bc786dc79 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.571467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.571467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.571467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.571729] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f695b5b2-1111-4adc-ab08-434bc786dc79',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.923410] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 835.923599] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 835.923719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.923885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.924128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.924324] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.924550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.924550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.924641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.924875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.924875] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.012151] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.012384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.012446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.012641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.013515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.013515] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.013515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.013515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.013515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.013515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.013515] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 is going to be updated. [ 836.041240] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.041450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.041450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.041689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.041835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.049810] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 in Status: IN_PROGRESS for 2s [ 836.077242] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.077621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.077747] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f695b5b2-1111-4adc-ab08-434bc786dc79 with status ACTIVE [ 836.077953] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.080823] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.080823] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.080823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.082114] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f695b5b2-1111-4adc-ab08-434bc786dc79 is going to be updated. [ 836.175155] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 836.175155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.176688] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.177045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.177045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.177181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.177281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.177418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f695b5b2-1111-4adc-ab08-434bc786dc79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.266850] env[69219]: INFO networking_nsxv3.common.synchronization [req-fcd8f8da-5206-4c00-a3c5-3c834fd8cc6b req-d3d31f98-a1fe-419a-a4a5-a1598dee61d9 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 836.267657] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 836.268426] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.268426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.268807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.269119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.269313] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.269418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.269484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.269640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.269725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.269823] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.426868] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.621538] env[69219]: INFO networking_nsxv3.common.synchronization [None req-92ce3104-8942-47b9-b0eb-44e72ab3eb94 None None] Enqueued Resource ID: 36500335-cef5-455a-a666-2c84b7368901 with Priority: HIGHEST for action port [ 836.621977] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36500335-cef5-455a-a666-2c84b7368901 with Priority: HIGHEST for action port [ 836.622532] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-36500335-cef5-455a-a666-2c84b7368901 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.622532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36500335-cef5-455a-a666-2c84b7368901" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.622532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36500335-cef5-455a-a666-2c84b7368901" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.622776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36500335-cef5-455a-a666-2c84b7368901" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.622862] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36500335-cef5-455a-a666-2c84b7368901',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.772400] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.772586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.772848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.772954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.773056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.773276] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.773366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.773438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.773593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.773669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.773751] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a already deleted. [ 836.773855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.905791] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.905985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.906128] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.906447] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.906711] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.906864] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.906981] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.907360] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.907590] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.907854] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.908035] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.908186] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.908359] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.908462] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.908708] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.908771] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.929278] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.933859] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.934027] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.934174] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.934358] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.934822] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9be9cb46-e7cf-436b-a654-100ca94253b9 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.935031] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.935258] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.935594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.935670] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9be9cb46-e7cf-436b-a654-100ca94253b9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.127599] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36500335-cef5-455a-a666-2c84b7368901 [ 837.127940] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.128141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.128266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.128599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.128794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.128888] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36500335-cef5-455a-a666-2c84b7368901 already deleted. [ 837.128968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36500335-cef5-455a-a666-2c84b7368901" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.431103] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.431270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.431338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.431597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.431694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.431796] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 837.438978] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.439268] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.439420] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.439734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.439832] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.440014] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9be9cb46-e7cf-436b-a654-100ca94253b9 not found, creating... [ 837.441577] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.441682] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.441799] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.442117] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.442193] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.442495] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.442653] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.442795] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.443042] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.443182] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.443330] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9be9cb46-e7cf-436b-a654-100ca94253b9 is going to be created. [ 837.459761] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.459960] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.460669] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.461311] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.461819] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.462194] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.463845] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.463970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.464027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.464761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.464761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.471820] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 838.062426] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 in Status: SUCCESS [ 838.062426] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 deletion is rescheduled due to dependency. [ 838.062426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.201103] env[69219]: INFO networking_nsxv3.common.synchronization [None req-909d8c05-fe4f-4dec-8783-0b4c879daa5a None None] Enqueued Resource ID: af6c2179-b6d7-450d-afe6-376b7e507dd8 with Priority: HIGHEST for action port [ 838.201712] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af6c2179-b6d7-450d-afe6-376b7e507dd8 with Priority: HIGHEST for action port [ 838.202709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-af6c2179-b6d7-450d-afe6-376b7e507dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.203038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af6c2179-b6d7-450d-afe6-376b7e507dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.203186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af6c2179-b6d7-450d-afe6-376b7e507dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.203509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af6c2179-b6d7-450d-afe6-376b7e507dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.203642] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af6c2179-b6d7-450d-afe6-376b7e507dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.310525] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c8116c55-9591-44c6-8d8b-cacaa727eae4 tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_rules [ 838.311079] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_rules [ 838.311380] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.311507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.311575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.312035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.312175] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.441606] env[69219]: INFO networking_nsxv3.common.synchronization [None req-e87ac8b1-f794-4b5b-822f-f776f6f41e0c None None] Enqueued Resource ID: 2563049b-1e4b-44f7-97d4-caebf49450d0 with Priority: HIGHEST for action port [ 838.442184] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2563049b-1e4b-44f7-97d4-caebf49450d0 with Priority: HIGHEST for action port [ 838.443478] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-2563049b-1e4b-44f7-97d4-caebf49450d0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.443478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2563049b-1e4b-44f7-97d4-caebf49450d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.443478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2563049b-1e4b-44f7-97d4-caebf49450d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.443778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2563049b-1e4b-44f7-97d4-caebf49450d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.443778] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2563049b-1e4b-44f7-97d4-caebf49450d0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.465175] env[69219]: INFO networking_nsxv3.common.synchronization [None req-15b148f0-1ce3-495e-b01e-9d59123db787 tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_rules [ 838.468073] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_rules [ 838.468073] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.468073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.482856] env[69219]: INFO networking_nsxv3.common.synchronization [req-fcd8f8da-5206-4c00-a3c5-3c834fd8cc6b req-adf37d62-0e07-4af3-805e-62afc4476f9e service nova] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 838.483467] env[69219]: INFO networking_nsxv3.common.synchronization [req-fcd8f8da-5206-4c00-a3c5-3c834fd8cc6b req-adf37d62-0e07-4af3-805e-62afc4476f9e service nova] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 838.483630] env[69219]: INFO networking_nsxv3.common.synchronization [req-fcd8f8da-5206-4c00-a3c5-3c834fd8cc6b req-adf37d62-0e07-4af3-805e-62afc4476f9e service nova] Enqueued Resource ID: 9be9cb46-e7cf-436b-a654-100ca94253b9 with Priority: HIGHEST for action port [ 838.484271] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 838.484409] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 838.484506] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be9cb46-e7cf-436b-a654-100ca94253b9 with Priority: HIGHEST for action port [ 838.484851] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.485578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.485712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.486156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.486383] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.487352] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.487519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.487663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.488383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.488383] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.488598] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.488636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.489727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.489982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.490308] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.492965] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9be9cb46-e7cf-436b-a654-100ca94253b9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.493632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.493751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.495955] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9be9cb46-e7cf-436b-a654-100ca94253b9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.631347] env[69219]: INFO networking_nsxv3.common.synchronization [req-27e185b3-794d-4be8-b40b-23b50a9f0b32 req-97d07d92-4af2-4814-a14b-f0d063084fa7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 838.633108] env[69219]: INFO networking_nsxv3.common.synchronization [req-27e185b3-794d-4be8-b40b-23b50a9f0b32 req-97d07d92-4af2-4814-a14b-f0d063084fa7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 838.633108] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 838.633108] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 838.633108] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.633108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.633108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.633824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.634104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.636969] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.636969] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.636969] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.636969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.636969] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.706776] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af6c2179-b6d7-450d-afe6-376b7e507dd8 [ 838.709177] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.709177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.709177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.709177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.709177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.709177] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af6c2179-b6d7-450d-afe6-376b7e507dd8 already deleted. [ 838.709177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af6c2179-b6d7-450d-afe6-376b7e507dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.767171] env[69219]: INFO networking_nsxv3.common.synchronization [req-27e185b3-794d-4be8-b40b-23b50a9f0b32 req-97d07d92-4af2-4814-a14b-f0d063084fa7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_rules [ 838.767171] env[69219]: INFO networking_nsxv3.common.synchronization [req-27e185b3-794d-4be8-b40b-23b50a9f0b32 req-97d07d92-4af2-4814-a14b-f0d063084fa7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 838.767171] env[69219]: INFO networking_nsxv3.common.synchronization [req-27e185b3-794d-4be8-b40b-23b50a9f0b32 req-97d07d92-4af2-4814-a14b-f0d063084fa7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 838.767171] env[69219]: INFO networking_nsxv3.common.synchronization [req-27e185b3-794d-4be8-b40b-23b50a9f0b32 req-97d07d92-4af2-4814-a14b-f0d063084fa7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 838.767390] env[69219]: INFO networking_nsxv3.common.synchronization [req-27e185b3-794d-4be8-b40b-23b50a9f0b32 req-97d07d92-4af2-4814-a14b-f0d063084fa7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 with Priority: HIGHEST for action port [ 838.767994] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_rules [ 838.769218] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 838.769352] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 with Priority: HIGHEST for action port [ 838.769519] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 838.769645] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 838.770036] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.770204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.770297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.770517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.770595] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.771455] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.771579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.771638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.771806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.771885] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.772613] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-effd0fbc-96ff-4722-96eb-50c6d7d02081 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.772725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.772783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.772931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.773008] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effd0fbc-96ff-4722-96eb-50c6d7d02081',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.776732] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.776732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.776732] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.776732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.835055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.835055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.835055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.835055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.835055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.835055] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 already deleted. [ 838.835055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.836597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.836780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.836864] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.947360] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2563049b-1e4b-44f7-97d4-caebf49450d0 [ 838.947360] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.947360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.947360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.947360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.947360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.947360] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2563049b-1e4b-44f7-97d4-caebf49450d0 already deleted. [ 838.947360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2563049b-1e4b-44f7-97d4-caebf49450d0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.998083] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.998189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.998359] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.999270] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9be9cb46-e7cf-436b-a654-100ca94253b9 with status ACTIVE [ 838.999847] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.999847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.999847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.999847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.000295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.000295] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.000295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.000295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.000527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.000576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.000734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.000827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.000876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.001047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.004339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.004339] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9be9cb46-e7cf-436b-a654-100ca94253b9 is going to be updated. [ 839.023750] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.023750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.023750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.023919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.023919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.024306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9be9cb46-e7cf-436b-a654-100ca94253b9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.041264] env[69219]: INFO networking_nsxv3.common.synchronization [req-7f77ce83-aece-4432-984f-2ccdf0574af1 req-b3082f67-f753-4fb0-9ed5-2aa6a5dc6be9 tempest-ServerActionsV293TestJSON-1968701766 tempest-ServerActionsV293TestJSON-1968701766-project-member] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_members [ 839.041987] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_members [ 839.042304] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.042395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.042495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.042677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.042928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.042928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.043135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.043135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.043300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.043484] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.139036] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.139983] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.278350] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port effd0fbc-96ff-4722-96eb-50c6d7d02081 with status ACTIVE [ 839.278577] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.278708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.278782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.279709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.279709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.279709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.279709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.279709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.279709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.279709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.280095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.280095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.280095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.280206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.280252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.280345] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 is going to be updated. [ 839.285640] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.285762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.286013] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.286097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.306737] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.306869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.306936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.307160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.307318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.307482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.370126] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.370264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.370331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.370542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.370629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.370724] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 already deleted. [ 839.373688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.483315] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 839.483540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.483711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.483930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.484138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.484285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.484351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.484504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.484611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.484698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.484792] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.508703] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.545520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.546017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.546017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.546017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.546160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.546289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.546381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.546441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.546598] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.546684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.546768] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 already deleted. [ 839.546852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.578020] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-405 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.578020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.578020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.578020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.578307] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.578439] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.578475] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.579087] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.579087] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.579087] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.580493] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.581610] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.581724] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.581851] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.581966] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.582110] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.604209] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.604209] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.604209] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.604209] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-405" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.604209] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-ecb02e25-b1d1-49fe-86a2-1f463c215956 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.604209] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.604209] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.604621] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.604621] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecb02e25-b1d1-49fe-86a2-1f463c215956',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.643764] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.643949] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.987129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.987409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.987409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.987658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.987842] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.987958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.988014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.988172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.988262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.988349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.988499] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.988592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.988653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.988913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.989054] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.989054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.989144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.989226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.989350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.989445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.989570] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.012597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.012810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.012810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.013047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.013141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.013237] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be created. [ 840.036300] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.036443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.036513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.036728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.036884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.046937] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: UNINITIALIZED for 2s [ 840.114416] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.114639] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.114766] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.116158] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.116405] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.116573] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port ecb02e25-b1d1-49fe-86a2-1f463c215956 not found, creating... [ 840.116853] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.117035] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.117164] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.117461] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.117622] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.118032] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.118220] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.118338] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.118560] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.118696] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.118835] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: ecb02e25-b1d1-49fe-86a2-1f463c215956 is going to be created. [ 840.138780] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.138994] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.139133] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.139489] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.139765] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.140016] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.145832] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.145982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.146177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.146276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.146369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.146511] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be created. [ 840.147882] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.148081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.148081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.148767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.148767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.148767] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 840.174726] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.174726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.174726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.178023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.178023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.178023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.178023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.178303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.178609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.178609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.188184] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 840.188704] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: UNINITIALIZED for 2s [ 840.347904] env[69219]: INFO networking_nsxv3.common.synchronization [None req-36967030-24ca-4fdc-bace-15db75ac5ddf None None] Enqueued Resource ID: c3008159-bd7c-408f-9575-6354c3a25848 with Priority: HIGHEST for action port [ 840.348739] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3008159-bd7c-408f-9575-6354c3a25848 with Priority: HIGHEST for action port [ 840.349222] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3008159-bd7c-408f-9575-6354c3a25848 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.349409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3008159-bd7c-408f-9575-6354c3a25848" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.349493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3008159-bd7c-408f-9575-6354c3a25848" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.350916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3008159-bd7c-408f-9575-6354c3a25848" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.350916] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3008159-bd7c-408f-9575-6354c3a25848',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.413369] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_members [ 840.413583] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 840.413754] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 840.418519] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_members [ 840.418670] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 840.418783] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 840.419705] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3afd8a02-3b29-4be8-aae2-a4f15df4f234 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.420030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.420030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.422669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.422669] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.422669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.422669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.480787] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_rules [ 840.482022] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_members [ 840.482022] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_rules [ 840.482022] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 840.482022] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 840.483518] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 840.485034] env[69219]: INFO networking_nsxv3.common.synchronization [req-e1198e90-5a13-4745-8517-177f9719500a req-9f283c47-b49c-4932-9984-bb194221b27e tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 with Priority: HIGHEST for action port [ 840.485034] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_rules [ 840.485034] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_rules [ 840.485034] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 840.485034] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 with Priority: HIGHEST for action port [ 840.485034] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 840.485034] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_members [ 840.485352] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 840.485424] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.485557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.485618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.485887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.485977] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.487537] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.487642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.487958] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.488064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.488264] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-effd0fbc-96ff-4722-96eb-50c6d7d02081 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.488359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.488431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.488654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.490108] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('effd0fbc-96ff-4722-96eb-50c6d7d02081',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.490108] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.490108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.490522] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3afd8a02-3b29-4be8-aae2-a4f15df4f234 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.490522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.490596] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.490661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.492775] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 840.511528] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.511710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.511839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.512152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.512264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.512472] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.512622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.512711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.512879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.512975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.513209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.513308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.513403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.513607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.513678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.514164] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.514276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.514353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.514530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.519019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.519019] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 840.673969] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.675167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.675167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.675167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.675167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.697372] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 840.852621] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3008159-bd7c-408f-9575-6354c3a25848 [ 840.852621] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.852621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.852621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.853197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.853197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.853197] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3008159-bd7c-408f-9575-6354c3a25848 already deleted. [ 840.854542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3008159-bd7c-408f-9575-6354c3a25848" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.925296] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.991790] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port effd0fbc-96ff-4722-96eb-50c6d7d02081 with status ACTIVE [ 840.992043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.992172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.992239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.992455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.992543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.992739] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.992835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.992895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.993054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.993125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.993329] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.993439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.993856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.993856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.993856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.993856] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: effd0fbc-96ff-4722-96eb-50c6d7d02081 is going to be updated. [ 840.996022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3afd8a02-3b29-4be8-aae2-a4f15df4f234 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.996404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.014365] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.015345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.015437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.015647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.015792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.015952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-effd0fbc-96ff-4722-96eb-50c6d7d02081" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.073222] env[69219]: INFO networking_nsxv3.common.synchronization [req-7f77ce83-aece-4432-984f-2ccdf0574af1 req-5e3a350c-c984-4245-843b-216e5712db71 service nova] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_rules [ 841.073222] env[69219]: INFO networking_nsxv3.common.synchronization [req-7f77ce83-aece-4432-984f-2ccdf0574af1 req-5e3a350c-c984-4245-843b-216e5712db71 service nova] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_members [ 841.073222] env[69219]: INFO networking_nsxv3.common.synchronization [req-7f77ce83-aece-4432-984f-2ccdf0574af1 req-5e3a350c-c984-4245-843b-216e5712db71 service nova] Enqueued Resource ID: ecb02e25-b1d1-49fe-86a2-1f463c215956 with Priority: HIGHEST for action port [ 841.073222] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_rules [ 841.073222] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_members [ 841.073222] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecb02e25-b1d1-49fe-86a2-1f463c215956 with Priority: HIGHEST for action port [ 841.073222] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.073222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.073222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.073222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.073222] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.074605] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.074605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.074605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.075090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.075179] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.075236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.075277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.075418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.075707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.075810] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.076646] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecb02e25-b1d1-49fe-86a2-1f463c215956 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.076795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.076873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.076968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.077047] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecb02e25-b1d1-49fe-86a2-1f463c215956',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.302307] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f1ba368f-6565-4a3f-a8e9-6bc100989a8f tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 7a534b2b-4678-4f7c-9930-c99bbde70f8f with Priority: HIGHEST for action security_group_rules [ 841.302901] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a534b2b-4678-4f7c-9930-c99bbde70f8f with Priority: HIGHEST for action security_group_rules [ 841.303841] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.303976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.304069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.304338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.304445] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a534b2b-4678-4f7c-9930-c99bbde70f8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.412291] env[69219]: INFO networking_nsxv3.common.synchronization [None req-9dfac903-9e39-46ac-92c6-f170ad6a7f0a None None] Enqueued Resource ID: 139ade2b-be2d-4b6b-afd0-3be1e6c92ffc with Priority: HIGHEST for action port [ 841.412291] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 139ade2b-be2d-4b6b-afd0-3be1e6c92ffc with Priority: HIGHEST for action port [ 841.412291] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-139ade2b-be2d-4b6b-afd0-3be1e6c92ffc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.412291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-139ade2b-be2d-4b6b-afd0-3be1e6c92ffc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.412291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-139ade2b-be2d-4b6b-afd0-3be1e6c92ffc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.412577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-139ade2b-be2d-4b6b-afd0-3be1e6c92ffc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.412762] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('139ade2b-be2d-4b6b-afd0-3be1e6c92ffc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.434907] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.519715] env[69219]: INFO networking_nsxv3.common.synchronization [None req-3f490140-2482-4dec-9ae8-15afdf3d2cc2 tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 7a534b2b-4678-4f7c-9930-c99bbde70f8f with Priority: HIGHEST for action security_group_rules [ 841.519715] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a534b2b-4678-4f7c-9930-c99bbde70f8f with Priority: HIGHEST for action security_group_rules [ 841.519715] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.519715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.587814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.587814] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.587814] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecb02e25-b1d1-49fe-86a2-1f463c215956 with status ACTIVE [ 841.587814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.587814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.587814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.588435] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.588435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.588435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.588435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.588435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.588435] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecb02e25-b1d1-49fe-86a2-1f463c215956 is going to be updated. [ 841.632315] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.632455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.632524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.632723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.632920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.633021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecb02e25-b1d1-49fe-86a2-1f463c215956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.735751] env[69219]: INFO networking_nsxv3.common.synchronization [req-239f7350-ba8b-400d-baab-b64721c9c4d5 req-8ebb9b2a-fbe4-47b2-88eb-69b4e3395be1 tempest-ServerRescueTestJSON-570394754 tempest-ServerRescueTestJSON-570394754-project-member] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 841.736385] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 841.736725] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.736831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.736877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.740043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.740293] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.740394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.740437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.740607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.740706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.740883] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.826272] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.826272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.826272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.826272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.826272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.826272] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a534b2b-4678-4f7c-9930-c99bbde70f8f already deleted. [ 841.826272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.826272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.826272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.826272] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a534b2b-4678-4f7c-9930-c99bbde70f8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.917578] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 139ade2b-be2d-4b6b-afd0-3be1e6c92ffc [ 841.917578] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.917578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.917578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.917578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.917578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.919856] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:139ade2b-be2d-4b6b-afd0-3be1e6c92ffc already deleted. [ 841.919856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-139ade2b-be2d-4b6b-afd0-3be1e6c92ffc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.936925] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.936925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.936925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.936925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.937118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.937118] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 is going to be created. [ 841.982116] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.982116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.982116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.982259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.983906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.998484] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: UNINITIALIZED for 2s [ 842.065192] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: SUCCESS [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.065192] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.065192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.065192] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.091571] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.184200] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.184200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.184200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.184200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.184200] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.184200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.184200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.184200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.184200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.184200] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.184200] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.184200] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.184200] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.184861] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.184861] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.184861] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.203171] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 842.203314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.204699] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.204961] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 842.205188] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.205405] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.205763] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.205988] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.206216] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.206843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.207088] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.207959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.208228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.208471] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.209102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.209546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.209899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.210056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.213020] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.213020] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: SUCCESS [ 842.213020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.213020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.213020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.213525] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.213525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.213525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.213775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.213855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.214608] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.245114] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.245114] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.245114] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 already deleted. [ 842.245114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.349936] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.349936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.349936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.350394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.350394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.350394] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a534b2b-4678-4f7c-9930-c99bbde70f8f already deleted. [ 842.350815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a534b2b-4678-4f7c-9930-c99bbde70f8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.567471] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.593770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.593770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.593770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.594642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.595396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.595396] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 is going to be created. [ 842.629591] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.629761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.629801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.629987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.630160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.644665] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: UNINITIALIZED for 2s [ 842.712838] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.713149] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.713199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.713523] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.714541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.714541] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f not found, creating... [ 842.714541] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.714541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.714541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.714846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.714846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.714999] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.715168] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.715282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.715482] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.715633] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.715772] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f is going to be created. [ 842.718199] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 842.718389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.718882] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.719691] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.750298] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.750495] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.750652] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.750944] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.752783] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.753271] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.806312] env[69219]: INFO networking_nsxv3.common.synchronization [None req-0cbc2ec4-0d41-4592-9070-e990dceb8b33 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_rules [ 842.806879] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_rules [ 842.808159] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.808159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.808472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.808635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.808635] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.055209] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2a16046d-d3e7-4147-99ab-862e7ac0fcff tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_rules [ 843.055209] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_rules [ 843.055983] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.055983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.069961] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e7926-33dc-450f-9584-34ddbd0ed03a: rpc.has_security_group_logging(os_id): False [ 843.089582] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.089910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.090134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.090458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.092034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.092034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.092034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.092034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.092034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.092034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.092034] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be created. [ 843.168105] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.168105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.168105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.168105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.168105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.183184] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: IN_PROGRESS for 2s [ 843.221413] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.224953] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.335648] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.335838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.335838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.337385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.337385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.337385] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d already deleted. [ 843.337385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.337385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.337385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.337385] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.509037] env[69219]: INFO networking_nsxv3.common.synchronization [req-239f7350-ba8b-400d-baab-b64721c9c4d5 req-e33b5611-44a5-428e-83e5-2d708fffd2ed service nova] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_rules [ 843.509373] env[69219]: INFO networking_nsxv3.common.synchronization [req-239f7350-ba8b-400d-baab-b64721c9c4d5 req-e33b5611-44a5-428e-83e5-2d708fffd2ed service nova] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 843.509428] env[69219]: INFO networking_nsxv3.common.synchronization [req-239f7350-ba8b-400d-baab-b64721c9c4d5 req-e33b5611-44a5-428e-83e5-2d708fffd2ed service nova] Enqueued Resource ID: d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f with Priority: HIGHEST for action port [ 843.510511] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_rules [ 843.510511] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 843.510511] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f with Priority: HIGHEST for action port [ 843.513311] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.522188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.522188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.522188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.522188] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.522188] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.522188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.522188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.522188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.522516] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.522516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.522516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.522639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.522806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.522806] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.523619] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.523723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.524499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.524499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.524499] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.726559] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.726720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.726795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.727225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.727350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.727463] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 843.732918] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.737035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.737035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.737035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.737035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.737035] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be updated. [ 843.766063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.766810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.766887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.767134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.767371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.770923] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.771056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.773027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.773027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.773027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.782990] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 843.784561] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: IN_PROGRESS for 2s [ 843.889112] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.889496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.889615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.889864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.889986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.890109] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d already deleted. [ 843.890233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.013041] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: SUCCESS [ 844.013041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.013041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.013041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.013041] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.013041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.013041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.013041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.013041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.013531] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.030634] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.030786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.030963] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.032252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f with status ACTIVE [ 844.032362] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.032538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.032671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.032941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.036235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.036586] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.036679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.036714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.036898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.037027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.037252] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.038240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.038240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.038240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.038240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.038240] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f is going to be updated. [ 844.059009] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.060116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.060116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.060116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.060116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.060116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5ce5fde-f59d-47b0-b5b1-9778ed78eb0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.518768] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.540221] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.655931] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: SUCCESS [ 844.655931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.656099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.656267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.656496] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.656858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.656858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.656966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.657010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.657140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.657256] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.020395] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.042736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.042900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.042978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.043301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.043404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.043508] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be created. [ 845.070039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.070196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.070196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.070422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.070663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.081056] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: UNINITIALIZED for 2s [ 845.159342] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.169620] env[69219]: INFO networking_nsxv3.common.synchronization [req-51825649-ee4c-4cb4-8377-56bc4a8a6b01 req-f5cdf2da-9ca1-4d4e-9fc8-a206489cfa1d tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 845.170164] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 845.170495] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.170622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.170692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.170890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.173996] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.174168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.174238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.174464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.174536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.174637] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.196172] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: SUCCESS [ 845.196448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.481677] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.481881] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.482071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.482421] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.482695] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.482855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.482976] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.489023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.489023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.489023] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.489023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.489023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.489023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.489023] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 845.489023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.489023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.509261] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.509261] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 845.509261] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.509261] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-232" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.509261] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.509261] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.509261] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.509261] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.509261] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4f566a-0bc0-4d80-8790-8f4cc0813dd0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.526171] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.526171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.526171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.526171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.526171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.526171] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 is going to be updated. [ 845.580479] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.580674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.580755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.581011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.581177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.593368] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: IN_PROGRESS for 2s [ 845.662038] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc9fb959-a076-420f-a95e-66822d85fa97: rpc.has_security_group_logging(os_id): False [ 845.677478] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.685759] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.685759] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.685759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.687497] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 is going to be created. [ 845.760079] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.760079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.760079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.760498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.761441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.772442] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: IN_PROGRESS for 2s [ 845.797091] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 845.797091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.797091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.797091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.797465] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.797640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.797788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.798141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.798242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.798382] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.798556] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.800927] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: SUCCESS [ 845.801371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.801553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.801840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.802194] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.802396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.802500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.802746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.802889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.803074] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.804840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.805178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.805441] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.805644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.805744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.806434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.806434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.806434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.806434] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.811252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.811252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.811252] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.811252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.811252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.811252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.811252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.811252] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.013497] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.013497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.013497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.013497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.013497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.013497] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 not found, creating... [ 846.013497] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.013497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.013497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.014109] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.014109] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.014186] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.014378] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.014514] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.014786] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.014954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.015113] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 is going to be created. [ 846.046402] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.046642] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.047130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.047291] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.047543] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.047785] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.190572] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.308603] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.310551] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.310789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.311161] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.311927] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.696734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.696734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.696734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.696734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.696734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.696734] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 846.729019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.729019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.729019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.729019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.729019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.737012] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 846.813812] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.813812] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5538c90-15d8-4803-8aa4-ad7aa2b015b1: rpc.has_security_group_logging(os_id): False [ 846.814980] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.833521] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.833521] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.833521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.833521] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be created. [ 846.847939] env[69219]: INFO networking_nsxv3.common.synchronization [req-51825649-ee4c-4cb4-8377-56bc4a8a6b01 req-e4e678fb-bf12-4058-b349-dfde400cf41d service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 846.848064] env[69219]: INFO networking_nsxv3.common.synchronization [req-51825649-ee4c-4cb4-8377-56bc4a8a6b01 req-e4e678fb-bf12-4058-b349-dfde400cf41d service nova] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 846.848170] env[69219]: INFO networking_nsxv3.common.synchronization [req-51825649-ee4c-4cb4-8377-56bc4a8a6b01 req-e4e678fb-bf12-4058-b349-dfde400cf41d service nova] Enqueued Resource ID: cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 with Priority: HIGHEST for action port [ 846.848680] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_rules [ 846.848863] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 846.848923] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 with Priority: HIGHEST for action port [ 846.849722] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.849904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.850082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.850383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.850564] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.851496] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.851633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.851885] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.852035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.852128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.852341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.852457] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4f566a-0bc0-4d80-8790-8f4cc0813dd0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.911032] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.911266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.911370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.911606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.911828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.924748] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: IN_PROGRESS for 2s [ 847.092612] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: SUCCESS [ 847.093174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.093174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.093369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.094448] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.094448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.094448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.094448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.094448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.094448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.094448] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.315015] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.315211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.315258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.315460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.315556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.315997] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 847.317595] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.317733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.317814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.318010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.318103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.318389] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be updated. [ 847.349889] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.350040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.350118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.350335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.350501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.353871] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.354035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.354035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.354229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.354362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.355655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.355791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.355903] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 with status ACTIVE [ 847.356074] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.356202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.356251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.356415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.356450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.356597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.356688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.356748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.356904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.356978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.357171] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.357274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.357350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.357498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.357556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.357644] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc4f566a-0bc0-4d80-8790-8f4cc0813dd0 is going to be updated. [ 847.363014] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 847.371112] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: IN_PROGRESS for 2s [ 847.383225] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.383225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.383225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.383225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.383225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.383225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc4f566a-0bc0-4d80-8790-8f4cc0813dd0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.600520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.600520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.600520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.600520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.600520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.600520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.600520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.600520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.600953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.600953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.600953] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.600953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.600953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.601178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.601606] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.601606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.601606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.601606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.601806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.601806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.601866] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.606425] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: SUCCESS [ 847.606425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.606869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.606917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.607096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.607235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.607346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.607441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.607478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.607547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.607635] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.783455] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: SUCCESS [ 847.783455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.854246] env[69219]: INFO networking_nsxv3.common.synchronization [req-7f4c58c0-4dd3-4506-b330-09f5df25707f req-64bab2b6-2205-4362-9d73-f1c1a625eac1 tempest-FloatingIPsAssociationTestJSON-828494427 tempest-FloatingIPsAssociationTestJSON-828494427-project-member] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 847.854801] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGHEST for action security_group_members [ 847.856555] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.856555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.856555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.857695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.857901] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.858073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.858194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.858515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.858515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.858637] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.107961] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c06b0f72-9b10-4089-a399-981c25e289e8: rpc.has_security_group_logging(os_id): False [ 848.109624] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.124390] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.124587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.124698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.125034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.125296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.125390] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.125488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.125556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.125891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.125891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.126080] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.126134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.126167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.126331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.126408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.126585] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.126677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.126739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.126893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.126974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.127079] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be created. [ 848.182362] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.182899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.182899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.182899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.183067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.196285] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: IN_PROGRESS for 2s [ 848.248170] env[69219]: INFO networking_nsxv3.common.synchronization [req-00cad176-55ca-4df8-9127-722f4ef3ce80 req-a030fa67-3d23-4837-b8d2-774eeed87884 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 848.248874] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 848.250386] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.250560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.250628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.250822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.250978] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.251622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.251720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.251909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.251988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.252101] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.364031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.364031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.364031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.364031] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be updated. [ 848.391021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.391265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.391597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.391839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.392074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.400910] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: IN_PROGRESS for 2s [ 848.611413] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3afd8a02-3b29-4be8-aae2-a4f15df4f234: rpc.has_security_group_logging(os_id): False [ 848.635905] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.636136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.637986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.637986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.637986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.637986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.637986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.637986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.637986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.637986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.637986] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 is going to be created. [ 848.693916] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.694189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.694319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.694791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.694903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.710512] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: IN_PROGRESS for 2s [ 848.747853] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 848.748533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.748853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.749396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.749717] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.749966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.751250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.751250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.751250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.751250] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.754194] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.756278] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.756278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.756278] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 848.796362] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.796722] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.796722] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.800026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.800026] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.800026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.800026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.800026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.800026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.800026] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.800026] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.800026] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.800026] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.800026] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.800026] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.800026] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.810873] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.810873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.810873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.810873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.810873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.819805] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.822023] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.822023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.822023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.822023] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9032b6da-8127-4597-9c6f-f18c3eb23de1 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.822023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.822023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.822023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.822023] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9032b6da-8127-4597-9c6f-f18c3eb23de1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.823748] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 848.937179] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: SUCCESS [ 848.937179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.937769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.937980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.938085] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.253231] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.324503] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.324713] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.324836] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.325144] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.325291] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.325491] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9032b6da-8127-4597-9c6f-f18c3eb23de1 not found, creating... [ 849.325784] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.326053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.326240] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.326476] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.326646] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.327026] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.328937] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.329204] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.329572] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.329847] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.330126] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9032b6da-8127-4597-9c6f-f18c3eb23de1 is going to be created. [ 849.350052] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.350052] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.350052] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.350310] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.351030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.351030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.374048] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 849.374284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.374841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.375069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.375306] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.375504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.375692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.375785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.375870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.375966] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.381288] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: SUCCESS [ 849.381480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.381689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.381886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.382167] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.382349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.382423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.382577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.382657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.382753] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.443439] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.443439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.756156] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.878576] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.886955] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.081182] env[69219]: INFO networking_nsxv3.common.synchronization [req-00cad176-55ca-4df8-9127-722f4ef3ce80 req-d81a06b8-80e7-4226-8566-b0b16383d1b1 service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 850.081182] env[69219]: INFO networking_nsxv3.common.synchronization [req-00cad176-55ca-4df8-9127-722f4ef3ce80 req-d81a06b8-80e7-4226-8566-b0b16383d1b1 service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 850.081182] env[69219]: INFO networking_nsxv3.common.synchronization [req-00cad176-55ca-4df8-9127-722f4ef3ce80 req-d81a06b8-80e7-4226-8566-b0b16383d1b1 service nova] Enqueued Resource ID: 9032b6da-8127-4597-9c6f-f18c3eb23de1 with Priority: HIGHEST for action port [ 850.081705] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 850.081705] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 850.081705] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9032b6da-8127-4597-9c6f-f18c3eb23de1 with Priority: HIGHEST for action port [ 850.082440] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.082556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.082601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.082793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.082871] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.083698] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.083814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.083971] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9032b6da-8127-4597-9c6f-f18c3eb23de1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.084625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.084625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.084625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.084625] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9032b6da-8127-4597-9c6f-f18c3eb23de1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.209434] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: SUCCESS [ 850.209434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.258513] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.258716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.258790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.259053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.259209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.259361] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 850.286192] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.287155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.287155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.287155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.290542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.297282] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 850.381378] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.392676] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.410909] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 in Status: SUCCESS [ 850.411116] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 deletion is rescheduled due to dependency. [ 850.411261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.586454] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.586454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.592024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9032b6da-8127-4597-9c6f-f18c3eb23de1 with status ACTIVE [ 850.592024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.592024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.592024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.592024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.592024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9032b6da-8127-4597-9c6f-f18c3eb23de1 is going to be updated. [ 850.618715] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.618715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.618715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.618715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.618715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.618715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9032b6da-8127-4597-9c6f-f18c3eb23de1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.736181] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: SUCCESS [ 850.736181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.836019] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 850.837363] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 850.837363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.837363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.837363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.837363] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.837793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.837793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.837793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.837793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.837931] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.884984] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.884984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.884984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.885546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.885546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.885546] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 850.898012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.898012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.898012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.898335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.898335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.898335] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be updated. [ 850.928053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.928053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.928053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.928053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.928053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.935230] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.935407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.935463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.935722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.935965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.951953] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 850.952820] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: IN_PROGRESS for 2s [ 851.344661] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.847462] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.307339] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 852.307339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.307739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.307784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.308073] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.308928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.308928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.308928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.308928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.308928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.308928] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.350041] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.350422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.350553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.350806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.350996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.351125] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 852.380117] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.380337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.380337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.380617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.380758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.389656] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 852.812841] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.812841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.812841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.812841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.813214] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.813214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.813214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.813460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.813580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.813680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.813862] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.814014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.814082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.814303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.814481] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.814575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.814645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.814773] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.814850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.814929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.815041] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.964483] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 852.964779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.964879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.965113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.966085] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.966085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.966085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.966085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.966085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.966085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.966085] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.966493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.966493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.966493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.966600] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.966649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.966695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.966857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.966906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.966981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.967099] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.968700] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: SUCCESS [ 852.968891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.969065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.969257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.969466] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.969566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.969630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.969799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.969886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.969956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.970055] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.080154] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-1e0a4bce-a356-4733-bd7e-267a6c70d82b tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 853.080721] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 853.081043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.081168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.081228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.081424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.081562] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.081705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.081779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.081865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.081947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.082048] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.318210] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b911077-41e4-4e60-b59f-e672bb56c601: rpc.has_security_group_logging(os_id): False [ 853.336238] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.336413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.336518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.336796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.336893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.337118] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.337223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.337289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.337461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.337553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.337769] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.337857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.337918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.338234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.338691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.338923] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.339096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.339096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.339232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.339403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.339489] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 853.396652] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.396928] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.397139] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.397470] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.397822] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.398055] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.398230] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.398539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.398734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.399055] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.399228] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.399410] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.399585] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.399761] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 853.399919] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.400160] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.403088] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.403283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.403398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.403679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.403915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.418718] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 853.422288] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.422541] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 853.422725] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.422916] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.423348] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-8b307c7a-1569-486b-ba4f-45742449e5c3 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.423580] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.423724] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.424125] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.424396] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b307c7a-1569-486b-ba4f-45742449e5c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.471893] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd: rpc.has_security_group_logging(os_id): False [ 853.473282] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.502080] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.502080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.502080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.502364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.502364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.502551] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.502718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.502849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.503101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.503229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.503497] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.503604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.503659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.503820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.506855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.506855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.506855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.506855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.506855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.506855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.506855] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 853.585323] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.585323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.585323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.585926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.586546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.586546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.586696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.586814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.587125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.587230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.587339] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 853.619714] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.619899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.620169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.620444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.620633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.622918] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.623048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.623151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.623322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.623447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.638810] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 853.643223] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 853.929030] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.929030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.929030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.929030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.929030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.929030] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 8b307c7a-1569-486b-ba4f-45742449e5c3 not found, creating... [ 853.929030] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.929030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.929030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.929030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.930126] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.930813] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.931424] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.931808] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.932294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.932643] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.932951] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 8b307c7a-1569-486b-ba4f-45742449e5c3 is going to be created. [ 853.955227] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.955880] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.956571] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.956693] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.956907] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.957282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.975401] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5538c90-15d8-4803-8aa4-ad7aa2b015b1: rpc.has_security_group_logging(os_id): False [ 854.014480] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.014712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.014801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.015141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.015284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.015589] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.015732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.015823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.016058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.016149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.016267] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be updated. [ 854.083503] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.083682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.083735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.083937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.084106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.098647] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: IN_PROGRESS for 2s [ 854.399479] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 854.399820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.399820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.399957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.400176] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.400337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.400423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.400605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.400699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.400789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.400884] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.638853] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-878f889e-be68-470d-814b-59a09fa1c125 service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 854.639046] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-878f889e-be68-470d-814b-59a09fa1c125 service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 854.639190] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-878f889e-be68-470d-814b-59a09fa1c125 service nova] Enqueued Resource ID: 8b307c7a-1569-486b-ba4f-45742449e5c3 with Priority: HIGHEST for action port [ 854.639493] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 854.639656] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 854.639707] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b307c7a-1569-486b-ba4f-45742449e5c3 with Priority: HIGHEST for action port [ 854.640783] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.640783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.640783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.641270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.641414] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.642683] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.642884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.643159] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b307c7a-1569-486b-ba4f-45742449e5c3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.643317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.643458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.643808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.643955] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b307c7a-1569-486b-ba4f-45742449e5c3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.905261] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.905261] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.905261] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.905261] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.905261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.905897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.905897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.905897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.905897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.905897] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.147742] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.147847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.148545] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b307c7a-1569-486b-ba4f-45742449e5c3 with status ACTIVE [ 855.148545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.148545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.148545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.148545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.148811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.148811] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.148901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.148997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.149142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.149219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.149569] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.149728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.149728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.149960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.149960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.150715] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b307c7a-1569-486b-ba4f-45742449e5c3 is going to be updated. [ 855.182300] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.182300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.182300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.182300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.182300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.182300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b307c7a-1569-486b-ba4f-45742449e5c3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.407732] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03b383a8-62e8-454b-9d3c-ac3de2f9ba05: rpc.has_security_group_logging(os_id): False [ 855.427070] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.427229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.427318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.427552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.427649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.427870] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.427971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.428054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.428208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.428296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.428501] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.428599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.428660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.428799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.428873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.429070] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.430789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.430915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.431049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.431133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.431224] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 855.442211] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 855.442211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.501205] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.501343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.501401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.501611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.501782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.515716] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 855.652139] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 855.652381] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 deletion is rescheduled due to dependency. [ 855.653836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.654059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.654319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.654546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.654686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.654756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.654919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.659110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.659337] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.661395] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 855.661395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.661505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.661711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.661823] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.912077] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-cc5c4fa4-966a-4de7-8c9a-03c67dd720bd tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 855.912689] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 855.913124] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.913270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.116060] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: SUCCESS [ 856.116060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.143597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.143819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.143819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.144178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.144538] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.164652] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.165293] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.165601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.165816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.166137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.166436] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.168904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.168904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.168904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.168904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.168904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.168904] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.401039] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-477 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.401188] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.401245] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.401506] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.401778] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.402197] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.402197] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.402344] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.402599] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.402798] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.402924] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.403051] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.403191] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.403401] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.403454] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.403599] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.422105] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.422511] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.422511] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.422644] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-477" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.422976] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-ac6daf16-3549-496b-a3ac-9c4a6b64141d taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.423171] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.423292] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.423616] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.423758] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6daf16-3549-496b-a3ac-9c4a6b64141d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.648022] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.669876] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.671155] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.671298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.671384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.671647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.671850] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.671969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.672043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.672198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.672286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.672371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.672519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.672616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.672667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.672803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.672937] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.673257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.673338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.673540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.673630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.673716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.673800] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.926961] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.927236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.927364] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.927665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.927817] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.928015] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port ac6daf16-3549-496b-a3ac-9c4a6b64141d not found, creating... [ 856.928293] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.928470] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.928578] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.928806] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.928938] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.929234] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.929403] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.930037] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.930037] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.930037] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.930195] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: ac6daf16-3549-496b-a3ac-9c4a6b64141d is going to be created. [ 856.954674] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.954674] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.954674] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.954920] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.955163] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.955415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.152867] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.177900] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.177900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.177900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.177900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.177900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.177900] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 857.179446] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd: rpc.has_security_group_logging(os_id): False [ 857.203249] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.203408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.203484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.203665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.203758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.203968] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.204079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.204136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.204290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.204363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.204537] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.204642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.204733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.204835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.204907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.205111] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.205203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.205261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.205396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.205502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.205609] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 857.213264] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.213476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.213653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.213941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.214256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.224140] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 857.272039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.272039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.272039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.272452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.273030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.288076] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 857.531262] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 857.531262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.655531] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 857.659255] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 857.685015] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-632903a0-378f-4fe3-9f1a-a90df80b99ba service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 857.685212] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-632903a0-378f-4fe3-9f1a-a90df80b99ba service nova] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 857.685353] env[69219]: INFO networking_nsxv3.common.synchronization [req-5ad2bed7-4f84-4b09-aa9e-81e8a01e46a3 req-632903a0-378f-4fe3-9f1a-a90df80b99ba service nova] Enqueued Resource ID: ac6daf16-3549-496b-a3ac-9c4a6b64141d with Priority: HIGHEST for action port [ 857.686349] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_rules [ 857.686349] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 857.686349] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac6daf16-3549-496b-a3ac-9c4a6b64141d with Priority: HIGHEST for action port [ 857.686663] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.686722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.686861] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.686952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.687142] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac6daf16-3549-496b-a3ac-9c4a6b64141d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.687253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.687333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.687597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.687688] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac6daf16-3549-496b-a3ac-9c4a6b64141d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.192594] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac6daf16-3549-496b-a3ac-9c4a6b64141d with status ACTIVE [ 858.192850] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.192991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.193099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.193369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.193454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.193648] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.193818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.193818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.193954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.194076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.194261] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.194352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.194407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.194550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.194668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.194726] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac6daf16-3549-496b-a3ac-9c4a6b64141d is going to be updated. [ 858.214751] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.215037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.215144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.215454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.215713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.215932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac6daf16-3549-496b-a3ac-9c4a6b64141d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.479500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.479676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.479743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.479957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.495153] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 858.496111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.497567] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 858.525057] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.525057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.525057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.525057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.535860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.538285] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 858.538285] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 858.538285] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 858.576729] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.576729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.576729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.576991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.578750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.578750] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 858.639353] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.639594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.639648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.639849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.640094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.640346] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 858.691398] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.691548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.691618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.691826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.692050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.692284] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 858.692377] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'78b80fc8-a901-412d-adfd-ccd8a04c683d', 'bc9fb959-a076-420f-a95e-66822d85fa97', '27183d48-c6d5-4b19-8477-66d9f0a9fcb7', '3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c', 'b36cc984-3daf-4544-bdb5-0d70fbf12ba9', '62d3be3f-2845-4a57-b242-e49996f8eac5', 'a6f62def-0bf8-403b-b778-966080958ecc', '93dbd604-991d-4cfe-98b5-8b882a4f169c', '4400f28d-3242-47d4-b41d-7b3cbf9bbb75', '03b383a8-62e8-454b-9d3c-ac3de2f9ba05', '7b8eea57-ce57-4940-9c1a-cd39d18803e2', '0b911077-41e4-4e60-b59f-e672bb56c601', '5c6c0638-f9b4-4568-9b99-0d9d1235dd1c', 'd4dd29e2-bd83-4aa6-8057-859cad475a65', '1f349768-69c7-4906-9f16-20b4268d8357', '9c5354b9-81f9-4e22-bc81-6b10e24e0c2c', '825c0c18-33c1-4cb4-8480-e8d82499bbf3', 'fd19ce54-2cd0-4cbf-976d-9f64e5909283', 'ce450239-c791-4c8d-86b2-a1dd86547bbc', '66dbd3fd-dcc5-433c-8ce2-c27a2f44d005', 'c5538c90-15d8-4803-8aa4-ad7aa2b015b1', 'e223c622-11b3-472e-bc32-fa212373c375', 'ec5e6bce-48d8-4a26-8add-53a08d2b2afe', '2f8662e1-7633-4a32-9aae-91c642b75dd8', 'c06b0f72-9b10-4089-a399-981c25e289e8', '3afd8a02-3b29-4be8-aae2-a4f15df4f234', '9153ebdf-4f47-4818-bdd9-2172ee701c16', 'df327ac5-73cd-478c-b19b-3849894e070d', '04ba1205-02a7-4968-99ca-25d19305f8e9', '398e7926-33dc-450f-9584-34ddbd0ed03a', '0687614d-5fbe-486f-942e-47e8dcdc82e2', '39c47700-2196-4adc-afd5-b72e818055ee', 'd679379b-ec68-4cf7-8ccd-4f2d4d8b12dd', 'fd4746a8-624d-411a-b8a7-b5c965021a51'} {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 858.692478] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 858.712765] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.712977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.713062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.713294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.713413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.713549] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 858.713629] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 858.713703] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 858.767209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.767209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.767209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.767576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.768849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.770099] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 858.770099] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 858.770099] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 858.770099] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 858.770338] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 858.770338] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGH for action security_group_rules [ 858.770338] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGH for action security_group_rules [ 858.770443] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGH for action security_group_rules [ 858.770504] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGH for action security_group_rules [ 858.770583] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGH for action security_group_rules [ 858.770661] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGH for action security_group_rules [ 858.770756] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGH for action security_group_rules [ 858.770829] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGH for action security_group_rules [ 858.770909] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGH for action security_group_rules [ 858.770972] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGH for action security_group_rules [ 858.771107] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGH for action security_group_rules [ 858.771720] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGH for action security_group_rules [ 858.771841] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGH for action security_group_rules [ 858.771939] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGH for action security_group_rules [ 858.772047] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGH for action security_group_rules [ 858.772129] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGH for action security_group_rules [ 858.772209] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGH for action security_group_rules [ 858.772275] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGH for action security_group_rules [ 858.773039] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGH for action security_group_rules [ 858.773039] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGH for action security_group_rules [ 858.773039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.235084] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 859.235334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.235990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.235990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.236129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.236298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.236298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.236488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.236625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.236678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.236804] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.238641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.239118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.239436] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.239815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.239815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.239937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.239990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.240816] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.308909] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 859.309833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.686403] env[69219]: INFO networking_nsxv3.common.synchronization [req-eec01b8c-d8d9-4f8f-85a4-cc214ab9224a req-8205ecdc-55f2-42d3-b72b-43d993293daf tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 859.687175] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 859.687356] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6f62def-0bf8-403b-b778-966080958ecc with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f349768-69c7-4906-9f16-20b4268d8357 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce450239-c791-4c8d-86b2-a1dd86547bbc with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c with Priority: HIGH for action security_group_rules [ 859.695411] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.695411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.695411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.695411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.695411] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.695411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.695411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.696628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.696628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.696628] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.697464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b80fc8-a901-412d-adfd-ccd8a04c683d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.697601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.697650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.697804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.697877] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b80fc8-a901-412d-adfd-ccd8a04c683d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.699993] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.699993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.699993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.699993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.699993] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27183d48-c6d5-4b19-8477-66d9f0a9fcb7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.700239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6f62def-0bf8-403b-b778-966080958ecc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.700348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.703165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.703165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.703165] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6f62def-0bf8-403b-b778-966080958ecc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.704605] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f349768-69c7-4906-9f16-20b4268d8357 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.704920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.704920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.705092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.705092] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f349768-69c7-4906-9f16-20b4268d8357',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.705909] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.706038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.706096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.706261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.706356] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.707676] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce450239-c791-4c8d-86b2-a1dd86547bbc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.707676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.707676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.707932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.707997] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce450239-c791-4c8d-86b2-a1dd86547bbc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.709039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.709174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.709256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.709445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.709537] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd19ce54-2cd0-4cbf-976d-9f64e5909283',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.710819] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.710819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.710819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.711059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.711059] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.711233] env[69219]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 859.715138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.715138] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.715138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.715138] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.715138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.715138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.715605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.715605] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c6c0638-f9b4-4568-9b99-0d9d1235dd1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.716637] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.716753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.716817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.716986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.717072] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.718738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.718738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.718883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.719170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.719257] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.720502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.720666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.720736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.721195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.721272] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.722249] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.722364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.722415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.722589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.722667] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4400f28d-3242-47d4-b41d-7b3cbf9bbb75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.723533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62d3be3f-2845-4a57-b242-e49996f8eac5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.723642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.723989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.724180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.724268] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62d3be3f-2845-4a57-b242-e49996f8eac5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.725419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93dbd604-991d-4cfe-98b5-8b882a4f169c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.725555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.725610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.725760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.725832] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93dbd604-991d-4cfe-98b5-8b882a4f169c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.726887] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.727024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.727024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.727228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.727277] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b36cc984-3daf-4544-bdb5-0d70fbf12ba9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.727484] env[69219]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 859.728354] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.728468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.728562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.728737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.728810] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.729831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.729831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.729976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.730046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.730117] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.746958] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.746958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.748932] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.773888] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.775343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.775343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.775343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.778345] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.778508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.779799] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.779912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.784189] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.784301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.801618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.801618] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6f62def-0bf8-403b-b778-966080958ecc is going to be deleted. [ 859.802949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.802949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.818963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.819117] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f349768-69c7-4906-9f16-20b4268d8357 is going to be deleted. [ 859.820311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.820433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.844649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.844649] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b80fc8-a901-412d-adfd-ccd8a04c683d is going to be deleted. [ 859.844649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.844649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.861531] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.861531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.871371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.871634] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27183d48-c6d5-4b19-8477-66d9f0a9fcb7 is going to be deleted. [ 859.874750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.874750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.874900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.874973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6f62def-0bf8-403b-b778-966080958ecc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.880768] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.880923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.880976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.881207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.881327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.881516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f349768-69c7-4906-9f16-20b4268d8357" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.891126] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.891269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.891344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.891594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.891684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.891805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b80fc8-a901-412d-adfd-ccd8a04c683d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.933963] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.934128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.934227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.934463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.934559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.934704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27183d48-c6d5-4b19-8477-66d9f0a9fcb7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.198682] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.198837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.201836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.201836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.222755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.223086] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.223204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.223204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.223394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.223478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.223566] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 860.250668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.250668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.250668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.250668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.250668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.258591] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 860.265430] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.296654] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.296654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.296654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.296654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.297024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.297024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.297115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.297991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.297991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.297991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.297991] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.298584] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.298752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.298845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.300477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.303129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.304222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.304369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.304520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.304615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.304712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.304808] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.305842] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.305967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.306039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.306227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.306362] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.306460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.306525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.306658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.306740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.306859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.306947] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.310491] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.310645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.310704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.310873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.310988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.311595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.311703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.313496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.313696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.313696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.313824] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.316399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.316527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.316588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.316879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.317042] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.317144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.317208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.317606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.317606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.317606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.317606] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.319740] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.319858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.319925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.320115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.320209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.320306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.320367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.320542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.320632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.320719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.320956] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.325122] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.325230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.325559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.325559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.326029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.326147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.326210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.326366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.326453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.326649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.326649] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.435759] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.435918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.435990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.436410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.441034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.441034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.441034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.441034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.441034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.441034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.441705] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.441705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.442686] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.442686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.444988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.444988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.444988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.444988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.444988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.444988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.458263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.459226] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be deleted. [ 860.459599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.459599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.482496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.483397] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd19ce54-2cd0-4cbf-976d-9f64e5909283 is going to be deleted. [ 860.485026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.485026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.500818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.500944] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93dbd604-991d-4cfe-98b5-8b882a4f169c is going to be deleted. [ 860.501868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.502084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.508729] env[69219]: INFO networking_nsxv3.common.synchronization [req-715186f5-c310-4c6e-ac57-11c4a3e5acf4 req-acba2e44-0201-481f-96d9-6ac95db07872 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 860.510255] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 860.510255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.510255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.510255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.510743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.510971] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.511123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.511205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.511399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.511566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.511706] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.526426] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.526591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.532686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.532686] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce450239-c791-4c8d-86b2-a1dd86547bbc is going to be deleted. [ 860.533467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.533665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.544960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.545136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.567983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.568161] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62d3be3f-2845-4a57-b242-e49996f8eac5 is going to be deleted. [ 860.569600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.569837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.572801] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.572801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.612188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.612409] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c6c0638-f9b4-4568-9b99-0d9d1235dd1c is going to be deleted. [ 860.614987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.614987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.665137] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.665271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.696675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.696981] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b36cc984-3daf-4544-bdb5-0d70fbf12ba9 is going to be deleted. [ 860.697788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.698372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.757578] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.757578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.772375] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.772375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.772375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.772375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.772375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.772375] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 860.778546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.778546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.778737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.778807] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c is going to be deleted. [ 860.782317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.782630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.816161] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.816161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.816767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.821185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.821689] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.821823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.821881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.822441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.822596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.822648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.822972] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.822972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.823111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.823890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.823890] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.823890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.823890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.823890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.824176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.824176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.824176] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.825229] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.828667] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.828667] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.828667] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.828667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.829672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.829672] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.829672] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.829672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.834232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.834232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.834232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.834232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.834232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.834960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.834960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.834960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.834960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.834960] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.834960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.834960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.834960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.834960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.834960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.835676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.835718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.836546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.836546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.836546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.836546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.836546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.836785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.836785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.836870] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.837549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.837549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.837549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.837549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.837549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.837549] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.838478] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.844059] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.870252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.870252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4400f28d-3242-47d4-b41d-7b3cbf9bbb75 is going to be deleted. [ 860.873040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.873937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.873937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.873937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.873937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.873937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.874155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.874155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd19ce54-2cd0-4cbf-976d-9f64e5909283" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.874665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.874862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.875995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.879159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93dbd604-991d-4cfe-98b5-8b882a4f169c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.879896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.880113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.880232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.880333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce450239-c791-4c8d-86b2-a1dd86547bbc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.880492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.880648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.880726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.880837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c6c0638-f9b4-4568-9b99-0d9d1235dd1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.880985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.881135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.881207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.881349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62d3be3f-2845-4a57-b242-e49996f8eac5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.893107] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.893289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.893366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.893593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.893698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.893831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b36cc984-3daf-4544-bdb5-0d70fbf12ba9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.947535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.947916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.947916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.948074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.948074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.948178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ffd2f76-7d59-41e0-9b05-0b9b238e5e3c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.952176] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.952289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.952338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.952710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.952710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.973821] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 861.016498] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.017088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.017088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.017204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.051833] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.052019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.064082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.064536] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.064719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.064820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.066691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.066835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.066981] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 861.072138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.072138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.072337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.072404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4400f28d-3242-47d4-b41d-7b3cbf9bbb75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.078076] env[69219]: INFO networking_nsxv3.common.synchronization [req-02a51f73-406c-4d7d-b855-6ab7d44dd7e1 req-3ac4ad0e-912e-4d24-9574-fea0c1f7ce8c tempest-ServerTagsTestJSON-1335924937 tempest-ServerTagsTestJSON-1335924937-project-member] Enqueued Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_members [ 861.078826] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_members [ 861.081351] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.081504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.081580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.081864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.082101] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.082207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.082269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.082477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.082612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.082723] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.118892] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.118959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.118995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.119303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.119374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.130460] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 861.329649] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b8eea57-ce57-4940-9c1a-cd39d18803e2: rpc.has_security_group_logging(os_id): False [ 861.330764] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b911077-41e4-4e60-b59f-e672bb56c601: rpc.has_security_group_logging(os_id): False [ 861.339580] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c: rpc.has_security_group_logging(os_id): False [ 861.342897] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03b383a8-62e8-454b-9d3c-ac3de2f9ba05: rpc.has_security_group_logging(os_id): False [ 861.343820] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc9fb959-a076-420f-a95e-66822d85fa97: rpc.has_security_group_logging(os_id): False [ 861.345165] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4dd29e2-bd83-4aa6-8057-859cad475a65: rpc.has_security_group_logging(os_id): False [ 861.349146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.349373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.349564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.349828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.352464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.353564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.362903] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.363109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.364135] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.364135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.364909] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.365009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.365729] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.365824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.372362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.373233] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.373443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.373516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.373737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.373834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.374104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.374204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.374265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.374464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.374540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.374826] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.375269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.375366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.375540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.375621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.375753] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be updated. [ 861.376847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.377029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.395212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.395212] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.395212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.395212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.395212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.395212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.395815] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.395815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.395815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.395815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.395815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.396175] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.396175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.396175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.396300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.396337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.396768] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 861.397911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.398868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.415259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.415698] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.416045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.416211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.416530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.416735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.416962] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 is going to be updated. [ 861.420841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.420841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.439299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.439299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.446054] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.446054] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.446054] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.446054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.448202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.448202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.448202] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be updated. [ 861.448202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.448202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.452032] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.452032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.469826] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.469919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.470921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.471248] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.471348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.471408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.471659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.471698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.471797] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 is going to be updated. [ 861.472866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.473078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.473234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.475467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.475467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.510686] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.510686] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.510686] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.510686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.511439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.511439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.511439] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 861.513126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.513871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.514069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.515136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.515349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.515531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.523150] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: IN_PROGRESS for 2s [ 861.555511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.555765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.556088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.556336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.556591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.560251] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: IN_PROGRESS for 2s [ 861.594289] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 861.594289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.594289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.594289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.594289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.594289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.594289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.594289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.594289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.595014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.595014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.595014] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 already deleted. [ 861.595014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.596503] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.596721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.596721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.596928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.597097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.650966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.650966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.650966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.650966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.650966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.662082] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 2s [ 861.662848] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: IN_PROGRESS for 2s [ 861.697215] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 861.819026] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.819026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-308" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.819026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-308" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.819026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-308" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.819026] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.819026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.819026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.819026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.819026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.819026] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.819026] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.820440] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.820961] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.821292] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.821564] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.822319] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.843965] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.844169] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.844318] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.844499] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-308" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.846074] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-e62f556c-dc28-46f6-9856-628ebeadbc6e taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.846455] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.846684] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.848633] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.848633] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e62f556c-dc28-46f6-9856-628ebeadbc6e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.267945] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 862.268207] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d deletion is rescheduled due to dependency. [ 862.268293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.351159] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.351409] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.351543] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.351867] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.352032] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.352199] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port e62f556c-dc28-46f6-9856-628ebeadbc6e not found, creating... [ 862.352475] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.352701] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.352837] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.353083] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.353231] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.353522] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.353685] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.353805] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.358071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.358071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.358071] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: e62f556c-dc28-46f6-9856-628ebeadbc6e is going to be created. [ 862.382105] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.382105] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.382307] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.382699] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.382984] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.383756] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.983297] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 862.984764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.984764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.984764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.984764] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.984764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.984764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.985088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.985088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.985088] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.140204] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 863.140331] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 863.140457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.140649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.140875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.141083] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.142030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.142030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.142467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.142467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.142467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.142467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.142467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.142646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.142646] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.225421] env[69219]: INFO networking_nsxv3.common.synchronization [req-02a51f73-406c-4d7d-b855-6ab7d44dd7e1 req-5ffdbc30-1c8a-4957-8a51-a06961e43eed service nova] Enqueued Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_rules [ 863.225867] env[69219]: INFO networking_nsxv3.common.synchronization [req-02a51f73-406c-4d7d-b855-6ab7d44dd7e1 req-5ffdbc30-1c8a-4957-8a51-a06961e43eed service nova] Enqueued Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_members [ 863.225867] env[69219]: INFO networking_nsxv3.common.synchronization [req-02a51f73-406c-4d7d-b855-6ab7d44dd7e1 req-5ffdbc30-1c8a-4957-8a51-a06961e43eed service nova] Enqueued Resource ID: e62f556c-dc28-46f6-9856-628ebeadbc6e with Priority: HIGHEST for action port [ 863.226512] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_rules [ 863.226881] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_members [ 863.226881] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e62f556c-dc28-46f6-9856-628ebeadbc6e with Priority: HIGHEST for action port [ 863.227200] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.227366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.227470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.227785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.228284] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.229008] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.229162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.229247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.231357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.231357] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.231357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.231357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.231357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.231357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.231357] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.231357] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e62f556c-dc28-46f6-9856-628ebeadbc6e taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.231861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.231861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.231861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.231861] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e62f556c-dc28-46f6-9856-628ebeadbc6e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.489989] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.545414] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 863.545414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.571620] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: SUCCESS [ 863.571620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.608841] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 863.609310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.644844] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 863.665719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.665882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.665944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.666566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.666566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.666777] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.666878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.666936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.667286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.667389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.667590] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.667680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.667742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.667882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.668276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.668486] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.668589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.668649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.668768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.668840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.668920] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 863.690492] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: SUCCESS [ 863.690848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.691886] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 863.692204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.705446] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 863.705674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.735401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.737148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.737148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.737148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.737148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.737836] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.739643] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.739643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.739643] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e62f556c-dc28-46f6-9856-628ebeadbc6e with status ACTIVE [ 863.739643] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.739643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.739643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.739643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.739643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.740320] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.740320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.740320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.740320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.740320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.740320] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.740523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.740523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.740642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.740642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.740703] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e62f556c-dc28-46f6-9856-628ebeadbc6e is going to be updated. [ 863.749402] env[69219]: INFO networking_nsxv3.common.synchronization [req-c674fa78-4a77-4492-a769-a5d52d429b16 req-f4cce607-7035-49e5-99e0-c75d8f621ebf tempest-ServersTestFqdnHostnames-37187543 tempest-ServersTestFqdnHostnames-37187543-project-member] Enqueued Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_members [ 863.750274] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_members [ 863.750411] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.750792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.750792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.750937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.751045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.751151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.751227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.751358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.751440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.751533] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.784449] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 863.785518] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.785518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.785855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.785855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.785971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.786086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e62f556c-dc28-46f6-9856-628ebeadbc6e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.998723] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.120621] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.120809] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-744" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.120930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-744" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.121291] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-744" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.122290] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.122290] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.122290] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.125240] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.125240] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.125240] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.125240] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.125240] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.125240] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.125240] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.125240] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.125240] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.141881] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.142061] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.142985] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.142985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-744" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.142985] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-632b1ae3-d182-4ee6-b497-5a810f743cbf taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.142985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.142985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.143319] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.143420] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632b1ae3-d182-4ee6-b497-5a810f743cbf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.242868] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.257184] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.257184] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.257184] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d already deleted. [ 864.257184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.502206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.502206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.502206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.502206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.502206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.502206] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 864.530788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.530788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.530788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.530788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.530788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.538301] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 864.650044] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.650044] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.650275] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.650472] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.650689] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.650861] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 632b1ae3-d182-4ee6-b497-5a810f743cbf not found, creating... [ 864.651140] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.651306] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.651428] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.651662] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.651875] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.652184] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.652344] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.652472] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.652677] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.652815] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.652956] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 632b1ae3-d182-4ee6-b497-5a810f743cbf is going to be created. [ 864.671935] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.672150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.672280] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.672534] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.672757] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.672986] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.746219] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.746312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.746359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.746580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.746679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.746777] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 is going to be created. [ 864.769184] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.769405] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.769405] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.769752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.769913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.791507] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 in Status: UNINITIALIZED for 2s [ 865.392114] env[69219]: INFO networking_nsxv3.common.synchronization [req-c674fa78-4a77-4492-a769-a5d52d429b16 req-a3c903f6-a39f-4ebe-85aa-ee54bebba254 service nova] Enqueued Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_rules [ 865.392114] env[69219]: INFO networking_nsxv3.common.synchronization [req-c674fa78-4a77-4492-a769-a5d52d429b16 req-a3c903f6-a39f-4ebe-85aa-ee54bebba254 service nova] Enqueued Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_members [ 865.392114] env[69219]: INFO networking_nsxv3.common.synchronization [req-c674fa78-4a77-4492-a769-a5d52d429b16 req-a3c903f6-a39f-4ebe-85aa-ee54bebba254 service nova] Enqueued Resource ID: 632b1ae3-d182-4ee6-b497-5a810f743cbf with Priority: HIGHEST for action port [ 865.392114] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_rules [ 865.392114] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_members [ 865.392114] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 632b1ae3-d182-4ee6-b497-5a810f743cbf with Priority: HIGHEST for action port [ 865.398390] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.398512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.398612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.398787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.398873] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.400150] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.400303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.400372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.400903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.400903] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.401084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.401084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.401220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.401518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.401639] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.402480] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-632b1ae3-d182-4ee6-b497-5a810f743cbf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.402617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.402697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.403939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.403939] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632b1ae3-d182-4ee6-b497-5a810f743cbf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.799111] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 865.799373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.904974] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.905400] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.905524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.905682] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 632b1ae3-d182-4ee6-b497-5a810f743cbf with status ACTIVE [ 865.905849] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.905950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.906657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.906657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.906657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.906657] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.906657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.906657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.906902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.906902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.907094] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.907643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.907714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.907828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.907917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.908016] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 632b1ae3-d182-4ee6-b497-5a810f743cbf is going to be updated. [ 865.936282] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.936456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.936456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.936624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.936780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.936928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-632b1ae3-d182-4ee6-b497-5a810f743cbf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.409221] env[69219]: INFO networking_nsxv3.common.synchronization [req-c2f39462-9255-4331-b927-df1d53618c4e req-fcf44540-c745-46ec-b1b1-f588dc48696c tempest-InstanceActionsNegativeTestJSON-855919845 tempest-InstanceActionsNegativeTestJSON-855919845-project-member] Enqueued Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_members [ 866.409788] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_members [ 866.410057] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.411068] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.411068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.412627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.412627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.412627] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.412627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.412627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.412627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.412627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.412627] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.555024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 866.555275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.555781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.555998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.556206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.556397] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.556397] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.556534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.556614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.556698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.556846] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.556931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.556985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.557148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.557284] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.557399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.557494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.557650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.557728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.557810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.557898] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.805501] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 in Status: SUCCESS [ 866.805789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.805958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.806214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.806469] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.806584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.806728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.806891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.806891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.811164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.811418] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.913746] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.913943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.913979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.914359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.914359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.914359] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d is going to be created. [ 866.915767] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.915914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.916415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.916415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.916415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.916415] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.916733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.916733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.916733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.916733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.916915] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de8e111-6e0d-48d0-816d-62134145ea0f already deleted. [ 866.916915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.937109] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.940264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.940264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.940264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.940264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.947518] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d in Status: UNINITIALIZED for 2s [ 867.029120] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-87 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.029120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.029120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.029120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.029120] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.029120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.030049] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.030509] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.030794] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.031120] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.031344] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.031554] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.031763] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.031989] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.032209] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.032442] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.062779] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e223c622-11b3-472e-bc32-fa212373c375: rpc.has_security_group_logging(os_id): False [ 867.064632] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.064806] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.064965] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.065154] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.065468] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9fde92f7-122a-40ca-ba5b-e33600cedb29 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.065646] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.065767] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.066199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.067030] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fde92f7-122a-40ca-ba5b-e33600cedb29',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.083677] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.083852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.083934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.084145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.110156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.110425] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.110555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.110618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.111342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.111342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.111342] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.111342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.111342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.111702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.111702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.111819] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.111819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.111963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.112032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.115048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.115048] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 867.185363] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.185363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.185363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.185363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.185363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.197108] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 867.316272] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.317183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.317183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.317183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.317183] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.317183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.317183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.317183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.317636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.317636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.317636] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.317636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.317636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.317823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.317858] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.318613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.318613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.318613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.318613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.318613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.318613] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.569863] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.570424] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.570424] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.570736] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.570935] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.571186] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9fde92f7-122a-40ca-ba5b-e33600cedb29 not found, creating... [ 867.571506] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.571742] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.571858] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.572147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.572325] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.572652] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.572857] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.572999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.573255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.573400] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.573632] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9fde92f7-122a-40ca-ba5b-e33600cedb29 is going to be created. [ 867.608338] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.608613] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.608815] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.609179] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.609523] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.609794] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.822082] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7320ab62-aefe-4739-a54e-e995c8c00fd4: rpc.has_security_group_logging(os_id): False [ 867.840738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.840888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.840964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.841245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.841368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.841634] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.841806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.841889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.842056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.842139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.842367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.842480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.842595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.842756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.842833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.843596] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.843718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.843718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.843843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.843917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.845828] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 is going to be created. [ 867.902990] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.903196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.903244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.903426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.903607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.913157] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 in Status: IN_PROGRESS for 2s [ 868.295143] env[69219]: INFO networking_nsxv3.common.synchronization [req-c2f39462-9255-4331-b927-df1d53618c4e req-d53436e1-1e2a-4a4e-bbbd-423c11cd1772 service nova] Enqueued Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_rules [ 868.295340] env[69219]: INFO networking_nsxv3.common.synchronization [req-c2f39462-9255-4331-b927-df1d53618c4e req-d53436e1-1e2a-4a4e-bbbd-423c11cd1772 service nova] Enqueued Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_members [ 868.295499] env[69219]: INFO networking_nsxv3.common.synchronization [req-c2f39462-9255-4331-b927-df1d53618c4e req-d53436e1-1e2a-4a4e-bbbd-423c11cd1772 service nova] Enqueued Resource ID: 9fde92f7-122a-40ca-ba5b-e33600cedb29 with Priority: HIGHEST for action port [ 868.297559] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_rules [ 868.297750] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_members [ 868.297854] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fde92f7-122a-40ca-ba5b-e33600cedb29 with Priority: HIGHEST for action port [ 868.298844] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.298844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.298844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.298844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.298844] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.301394] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.301527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.301665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.301806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.302738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.302738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.302738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.302738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.302738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.302738] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.304363] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fde92f7-122a-40ca-ba5b-e33600cedb29 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.304515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.304592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.304767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.304868] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fde92f7-122a-40ca-ba5b-e33600cedb29',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.807017] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.808488] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.808578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.808730] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fde92f7-122a-40ca-ba5b-e33600cedb29 with status ACTIVE [ 868.808928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.809050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.809050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.809234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.809317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.809504] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.809597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.809656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.809805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.809874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.810061] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.810148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.810199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.810330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.810398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.810563] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fde92f7-122a-40ca-ba5b-e33600cedb29 is going to be updated. [ 868.830159] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.830529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.830529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.830699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.830737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.830872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fde92f7-122a-40ca-ba5b-e33600cedb29" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.957926] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d in Status: SUCCESS [ 868.958157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.958454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.958749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.959976] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.959976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.959976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.959976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.959976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.959976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.959976] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.140018] env[69219]: INFO networking_nsxv3.common.synchronization [req-594108d2-7428-43f3-9b5a-2b97f232280d req-6e2ab8f7-d2c0-41e0-a82c-4e952642db43 tempest-VolumesAdminNegativeTest-292929570 tempest-VolumesAdminNegativeTest-292929570-project-member] Enqueued Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_members [ 869.140018] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_members [ 869.140018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.140018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.140018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.140018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.140018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.140018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.140018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.140763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.140933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.141120] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.210692] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 869.211076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.211477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.211814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.212986] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.312554] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.462567] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.625017] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-789 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.625260] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.625453] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.625650] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.625883] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.629155] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.629155] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.629155] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.629155] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.629155] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.629155] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.629155] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.629155] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.629155] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 869.629155] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.629155] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.645020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.645020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.645020] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e92a878-87ba-416d-b225-777db5147611 already deleted. [ 869.645020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.648471] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.648471] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 869.648709] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.648786] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-789" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.651909] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-8e16ec83-a442-457d-baad-0e4be12f6d07 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.652432] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.652432] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.652702] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.652863] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e16ec83-a442-457d-baad-0e4be12f6d07',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.714351] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.717013] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.717013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.717013] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.817304] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.817624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.817624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.817784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.817876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.817977] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de8e111-6e0d-48d0-816d-62134145ea0f is going to be created. [ 869.839409] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.839409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.839409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.839409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.839783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.855206] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de8e111-6e0d-48d0-816d-62134145ea0f in Status: UNINITIALIZED for 2s [ 869.869024] env[69219]: INFO networking_nsxv3.common.synchronization [req-a574a57b-8f56-47c8-8896-3cf6a7409b65 req-928f45d8-0646-4825-94ad-c3ac3da3da8d tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 869.869024] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 869.869024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.869024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.869024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.869325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.870338] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.870338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.870338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.870338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.870338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.870338] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.048588] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bbfcc96-5e86-4201-bca0-faab328daf1d: rpc.has_security_group_logging(os_id): False [ 870.050199] env[69219]: INFO networking_nsxv3.common.synchronization [req-ad97bb39-1bd3-44ac-9828-84843f6f955f req-100795ff-f14a-4e82-9802-fa1a85cacdbd tempest-MultipleCreateTestJSON-1045018452 tempest-MultipleCreateTestJSON-1045018452-project-member] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 870.051567] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGHEST for action security_group_members [ 870.052692] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.052798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.061781] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 in Status: SUCCESS [ 870.061990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.070253] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.070367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.070437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.070660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.070745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.070972] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.071084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.071145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.071289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.071362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.071451] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d is going to be created. [ 870.125156] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.125320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.125387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.125597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.125775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.134495] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d in Status: IN_PROGRESS for 2s [ 870.158381] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.158683] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.159872] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.159872] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.159872] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.159872] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 8e16ec83-a442-457d-baad-0e4be12f6d07 not found, creating... [ 870.159872] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.160153] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.160153] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.160299] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.160430] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.160709] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.160860] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.160994] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.161202] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.161317] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.161453] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 8e16ec83-a442-457d-baad-0e4be12f6d07 is going to be created. [ 870.184498] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.184498] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.184498] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.184498] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.184735] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.184873] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.219958] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.219958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.371988] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.874777] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.948178] env[69219]: INFO networking_nsxv3.common.synchronization [req-594108d2-7428-43f3-9b5a-2b97f232280d req-94589eed-7a24-478d-ac02-c87f838038d0 service nova] Enqueued Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_rules [ 870.948367] env[69219]: INFO networking_nsxv3.common.synchronization [req-594108d2-7428-43f3-9b5a-2b97f232280d req-94589eed-7a24-478d-ac02-c87f838038d0 service nova] Enqueued Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_members [ 870.948509] env[69219]: INFO networking_nsxv3.common.synchronization [req-594108d2-7428-43f3-9b5a-2b97f232280d req-94589eed-7a24-478d-ac02-c87f838038d0 service nova] Enqueued Resource ID: 8e16ec83-a442-457d-baad-0e4be12f6d07 with Priority: HIGHEST for action port [ 870.949058] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_rules [ 870.949224] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_members [ 870.949336] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e16ec83-a442-457d-baad-0e4be12f6d07 with Priority: HIGHEST for action port [ 870.949646] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.952898] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.952898] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.952898] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.952898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.952898] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.953758] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e16ec83-a442-457d-baad-0e4be12f6d07 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.953758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.953758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.953758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.953758] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e16ec83-a442-457d-baad-0e4be12f6d07',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.380510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.380664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.380760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.380957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.381068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.381172] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 871.412247] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.412446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.412622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.412743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.412899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.421525] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 871.455239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.455628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.455744] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.456881] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e16ec83-a442-457d-baad-0e4be12f6d07 with status ACTIVE [ 871.457142] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.457491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.457582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.457751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.457843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.458045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.458158] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.458215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.458381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.458464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.458655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.458748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.458803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.458941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.459023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.459109] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e16ec83-a442-457d-baad-0e4be12f6d07 is going to be updated. [ 871.487269] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.487566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.487566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.487713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.487850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.488159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e16ec83-a442-457d-baad-0e4be12f6d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.866043] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de8e111-6e0d-48d0-816d-62134145ea0f in Status: SUCCESS [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.866043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.866043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.866043] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.961700] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.146359] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d in Status: SUCCESS [ 872.146578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.371401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.371401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.371401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.371401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.371401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.372086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.372086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.372086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.372086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.372086] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.465999] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.465999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.465999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.465999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.465999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.465999] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e92a878-87ba-416d-b225-777db5147611 is going to be created. [ 872.486071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.486458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.488270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.488270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.488270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.495671] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e92a878-87ba-416d-b225-777db5147611 in Status: UNINITIALIZED for 2s [ 872.820273] env[69219]: INFO networking_nsxv3.common.synchronization [req-73d93521-9bb9-4463-8573-d080fa75a6cc req-c6d80886-bf6d-4828-891b-d046573c842e tempest-ServersWithSpecificFlavorTestJSON-1490539426 tempest-ServersWithSpecificFlavorTestJSON-1490539426-project-member] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 872.820997] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 872.823477] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.823600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.823664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.823882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.824034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.824155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.824217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.824383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.824478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.824586] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.882206] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1de8e111-6e0d-48d0-816d-62134145ea0f: rpc.has_security_group_logging(os_id): False [ 872.897812] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.898364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.898364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.898364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.898549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.898627] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.898749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.898811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.898974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.899054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.899305] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.899374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.899413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.899557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.899683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.899838] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.899935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.900024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.900241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.900322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.900399] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de8e111-6e0d-48d0-816d-62134145ea0f is going to be created. [ 872.963546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.966910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.966910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.966910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.966910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.976036] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de8e111-6e0d-48d0-816d-62134145ea0f in Status: IN_PROGRESS for 2s [ 873.330470] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.330722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.330807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.330981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.355368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.355368] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.355368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.355368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.355368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.355368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.355368] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 is going to be updated. [ 873.377281] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.377447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.377549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.377724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.377867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.387736] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: IN_PROGRESS for 2s [ 873.430451] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 873.430718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.430981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.431407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.431796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.431945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.431997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.432166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.432246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.432343] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.934773] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.934962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.935050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.935278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.935409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.935601] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.935706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.935771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.935972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.936130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.936226] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 873.961734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.961734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.961734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.961734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.961734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.969350] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 874.505149] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e92a878-87ba-416d-b225-777db5147611 in Status: SUCCESS [ 874.505338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.505533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.507796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.507796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.507796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.507796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.507796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.507796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.507796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.507796] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.606607] env[69219]: INFO networking_nsxv3.common.synchronization [req-4f7995ea-a426-412a-b6d3-9e21d60fdfd1 req-34bb43d3-6fe7-4a18-aba6-307a15a9f582 tempest-ServerPasswordTestJSON-791555509 tempest-ServerPasswordTestJSON-791555509-project-member] Enqueued Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_members [ 874.607314] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_members [ 874.607759] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e06ed06-d558-4f57-8586-39a8c2f2a293 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.607759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.608083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.608931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.609202] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.609333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.609419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.609657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.609760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.610093] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.994326] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1de8e111-6e0d-48d0-816d-62134145ea0f in Status: SUCCESS [ 874.994595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.013149] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.013549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.013677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.013942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.014186] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.014309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.014390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.014553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.014678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.014803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.014978] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.015127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.015359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.015432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.015571] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.015741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.015810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.016058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.016686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.016796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.016916] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.112302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.112302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.112429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.112732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.112880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.114063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.114063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.114063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.114063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.114063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.114063] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 already deleted. [ 875.114337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.204732] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-963 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.206855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-963" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.206855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-963" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.206855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-963" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.206855] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.206855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.206855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.207414] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.207676] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.208097] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.208350] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.210270] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.210270] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.210270] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.210270] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.210270] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.228685] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.228904] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 875.229075] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.229326] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-963" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.229773] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-3e80aba7-a5d8-4e32-88f0-20870934c4da taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.229985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.230125] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.230495] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.230684] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e80aba7-a5d8-4e32-88f0-20870934c4da',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.397007] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: SUCCESS [ 875.397802] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 deletion is rescheduled due to dependency. [ 875.397938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.524881] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e92a878-87ba-416d-b225-777db5147611: rpc.has_security_group_logging(os_id): False [ 875.543317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.544170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.544170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.544170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.544170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.544170] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.544170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.544170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.544520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.544520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.544590] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.544681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.544794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.544883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.544956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.545202] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.545298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.545360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.545496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.545759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.545852] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e92a878-87ba-416d-b225-777db5147611 is going to be created. [ 875.603193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.603345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.603408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.603624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.603930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.627021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e92a878-87ba-416d-b225-777db5147611 in Status: IN_PROGRESS for 2s [ 875.736490] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.736948] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.738029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.738029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.738029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.738029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 3e80aba7-a5d8-4e32-88f0-20870934c4da not found, creating... [ 875.738431] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.738618] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.738857] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.739178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.739392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.739795] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.740052] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.740243] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.740527] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.740777] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.740988] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 3e80aba7-a5d8-4e32-88f0-20870934c4da is going to be created. [ 875.762452] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.762709] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.762860] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.763657] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.767019] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.767019] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.979579] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 875.981224] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e223c622-11b3-472e-bc32-fa212373c375 deletion is rescheduled due to dependency. [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.981224] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.981224] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.981224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.982146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.982146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.982146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.982146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.982146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.982146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.982146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.985275] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.000264] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f4cc69b9-2634-4c99-9947-796b4f66ac1f None None] Enqueued Resource ID: 46eebccc-c1c6-41c6-b438-2b0c31503353 with Priority: HIGHEST for action port [ 876.000619] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46eebccc-c1c6-41c6-b438-2b0c31503353 with Priority: HIGHEST for action port [ 876.000794] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-46eebccc-c1c6-41c6-b438-2b0c31503353 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.001178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46eebccc-c1c6-41c6-b438-2b0c31503353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.001302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46eebccc-c1c6-41c6-b438-2b0c31503353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.001592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46eebccc-c1c6-41c6-b438-2b0c31503353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.001766] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46eebccc-c1c6-41c6-b438-2b0c31503353',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.488671] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e223c622-11b3-472e-bc32-fa212373c375: rpc.has_security_group_logging(os_id): False [ 876.504607] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46eebccc-c1c6-41c6-b438-2b0c31503353 [ 876.504909] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.505083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.505179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.505429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.505557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.505662] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46eebccc-c1c6-41c6-b438-2b0c31503353 already deleted. [ 876.505748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46eebccc-c1c6-41c6-b438-2b0c31503353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.506754] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.506871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.506938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.507122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.507205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.507407] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.507513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.507582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.508079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.508079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.508489] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.508489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.508849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.508912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.509579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.509579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.509579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.509579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.509579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.509823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.509823] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be updated. [ 876.567116] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.570063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.570215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.570692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.570854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.587018] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: IN_PROGRESS for 2s [ 876.666332] env[69219]: INFO networking_nsxv3.common.synchronization [req-4f7995ea-a426-412a-b6d3-9e21d60fdfd1 req-d873eadd-ff65-4ef9-ae78-225c1c850557 service nova] Enqueued Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_rules [ 876.666513] env[69219]: INFO networking_nsxv3.common.synchronization [req-4f7995ea-a426-412a-b6d3-9e21d60fdfd1 req-d873eadd-ff65-4ef9-ae78-225c1c850557 service nova] Enqueued Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_members [ 876.666655] env[69219]: INFO networking_nsxv3.common.synchronization [req-4f7995ea-a426-412a-b6d3-9e21d60fdfd1 req-d873eadd-ff65-4ef9-ae78-225c1c850557 service nova] Enqueued Resource ID: 3e80aba7-a5d8-4e32-88f0-20870934c4da with Priority: HIGHEST for action port [ 876.667195] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_rules [ 876.667331] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_members [ 876.667429] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e80aba7-a5d8-4e32-88f0-20870934c4da with Priority: HIGHEST for action port [ 876.667957] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e06ed06-d558-4f57-8586-39a8c2f2a293 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.668168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.668239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.668578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.668708] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.669915] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e06ed06-d558-4f57-8586-39a8c2f2a293 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.670053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.670188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.670380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.670642] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.670642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.670778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.670912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.671065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.671169] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.673610] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e80aba7-a5d8-4e32-88f0-20870934c4da taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.673755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.673819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.674082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.674082] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e80aba7-a5d8-4e32-88f0-20870934c4da',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.179491] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.180783] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e06ed06-d558-4f57-8586-39a8c2f2a293 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.180928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.181330] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e80aba7-a5d8-4e32-88f0-20870934c4da with status ACTIVE [ 877.181330] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.181544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.181544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.181637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.181710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.181943] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.182040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.182040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.182191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.182266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.182464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.182647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.182745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.182928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.183042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.184641] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e80aba7-a5d8-4e32-88f0-20870934c4da is going to be updated. [ 877.205079] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.205223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.205278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.205451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.205576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.205782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e80aba7-a5d8-4e32-88f0-20870934c4da" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.639071] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e92a878-87ba-416d-b225-777db5147611 in Status: SUCCESS [ 877.639071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.688595] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.976207] env[69219]: INFO networking_nsxv3.common.synchronization [req-47c92c96-9a1b-42b0-bdea-03e79aae28be req-4ab46d0b-a9d4-4b68-92ba-0414212ad435 tempest-MigrationsAdminTest-1548575404 tempest-MigrationsAdminTest-1548575404-project-member] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 877.976782] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 877.979034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.979034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.979034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.979034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.979034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.979034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.979034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.979034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.979034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.979034] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.194297] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.194762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.194762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.195100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.195231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.195231] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 is going to be created. [ 878.219299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.219656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.219656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.220092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.220272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.231014] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 in Status: UNINITIALIZED for 2s [ 878.480892] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.481133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.481133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.481365] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.481454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.481655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.481770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.481907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.481995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.482070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.482137] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 already deleted. [ 878.482216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.600404] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e223c622-11b3-472e-bc32-fa212373c375 in Status: SUCCESS [ 878.601088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.639150] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.639150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.639150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.639150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.639150] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.639150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.639150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.639150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.639150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.639150] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.639150] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.639150] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.639150] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.639721] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.639721] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.639721] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.663026] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.664120] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.664120] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.664120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.664120] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-0420956f-3eec-4f90-b91a-7631959fcff6 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.664120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.664417] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.664507] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.664654] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0420956f-3eec-4f90-b91a-7631959fcff6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.674209] env[69219]: INFO networking_nsxv3.common.synchronization [None req-46b31b02-dc0a-428e-84d3-18ffce687c30 None None] Enqueued Resource ID: b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9 with Priority: HIGHEST for action port [ 878.674739] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9 with Priority: HIGHEST for action port [ 878.675189] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.675341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.675410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.675701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.675776] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.167486] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.167788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.167926] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.168298] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.168457] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.168673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 0420956f-3eec-4f90-b91a-7631959fcff6 not found, creating... [ 879.169036] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.169212] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.169392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.169703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.169855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.170258] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.170531] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.170662] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.171463] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.171625] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.171774] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 0420956f-3eec-4f90-b91a-7631959fcff6 is going to be created. [ 879.177559] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9 [ 879.177761] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.177882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.177944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.178170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.178253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.178341] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9 already deleted. [ 879.178416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b752abcf-a709-4ae5-b8c6-efcdbb6bbdb9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.202523] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.202839] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.202839] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.203033] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.203260] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.203490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.093383] env[69219]: INFO networking_nsxv3.common.synchronization [req-47c92c96-9a1b-42b0-bdea-03e79aae28be req-3f751808-7659-4872-8eb5-a211862051e0 service nova] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_rules [ 880.093648] env[69219]: INFO networking_nsxv3.common.synchronization [req-47c92c96-9a1b-42b0-bdea-03e79aae28be req-3f751808-7659-4872-8eb5-a211862051e0 service nova] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 880.093771] env[69219]: INFO networking_nsxv3.common.synchronization [req-47c92c96-9a1b-42b0-bdea-03e79aae28be req-3f751808-7659-4872-8eb5-a211862051e0 service nova] Enqueued Resource ID: 0420956f-3eec-4f90-b91a-7631959fcff6 with Priority: HIGHEST for action port [ 880.095062] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_rules [ 880.095212] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 880.095315] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0420956f-3eec-4f90-b91a-7631959fcff6 with Priority: HIGHEST for action port [ 880.095612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.095753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.095823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.096072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.096157] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.097048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.097169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.097233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.097406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.097552] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.101139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.101139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.101139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.101139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.101139] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.101139] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.101139] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0420956f-3eec-4f90-b91a-7631959fcff6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.101139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.101139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.101139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.101139] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0420956f-3eec-4f90-b91a-7631959fcff6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.243344] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 in Status: SUCCESS [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.243344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.243344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.243344] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.602092] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.602092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.602092] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.602548] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0420956f-3eec-4f90-b91a-7631959fcff6 with status ACTIVE [ 880.602764] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.604140] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.604140] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.604140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.604498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.604498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.604630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.604700] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0420956f-3eec-4f90-b91a-7631959fcff6 is going to be updated. [ 880.632939] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.633119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.633204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.633424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.633561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.633766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0420956f-3eec-4f90-b91a-7631959fcff6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.746478] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e06ed06-d558-4f57-8586-39a8c2f2a293 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.746632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.746707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.747058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.747255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.747366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.747433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.747664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.747761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.747870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.748043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e06ed06-d558-4f57-8586-39a8c2f2a293 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.748156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.748216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.748362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.748502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.748655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.748655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.748811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.748899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.748986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.749104] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.107259] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.254286] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e06ed06-d558-4f57-8586-39a8c2f2a293: rpc.has_security_group_logging(os_id): False [ 881.275365] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.277904] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.277904] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.277904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.278545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.278545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.278545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.278545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.278545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.278545] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 is going to be created. [ 881.333298] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.333661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.333661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.333661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.334048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.344274] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 in Status: IN_PROGRESS for 2s [ 881.386103] env[69219]: INFO networking_nsxv3.common.synchronization [req-2b37128c-5974-4221-8d82-29dfc63bdf92 req-87e27615-2fe6-4b6e-86bc-f10b6b388155 tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_members [ 881.386103] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_members [ 881.386589] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.386843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.387015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.387357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.387757] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.387981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.388126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.388377] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.388547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.388731] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.609985] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.610128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.610193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.613325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.613325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.613325] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be created. [ 881.627388] env[69219]: INFO networking_nsxv3.common.synchronization [req-35416bcf-8d9c-477a-aeff-cc58dc9d283f req-0fde7263-d06d-4c4c-a147-9ca686a32644 tempest-ServerTagsTestJSON-1335924937 tempest-ServerTagsTestJSON-1335924937-project-member] Enqueued Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_members [ 881.627960] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGHEST for action security_group_members [ 881.628289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.628749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.628749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.628749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.628854] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.628914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.629435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.629435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.629435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.629435] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.634836] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.634836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.634836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.634836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.634836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.641997] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: UNINITIALIZED for 2s [ 881.678492] env[69219]: INFO networking_nsxv3.common.synchronization [req-cfc70810-293b-4fe7-bde2-b5e9fbb9f5e5 req-73720b2f-ce7d-4aad-9181-648ead14fa84 tempest-InstanceActionsNegativeTestJSON-855919845 tempest-InstanceActionsNegativeTestJSON-855919845-project-member] Enqueued Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_members [ 881.679205] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGHEST for action security_group_members [ 881.679716] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.679830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.679901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.680114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.680336] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.680488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.680557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.680710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.680793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.680882] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.893084] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.893298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.893396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.893656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.893782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.894027] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.894179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.894272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.894443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.894546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.894654] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 already deleted. [ 881.894756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.132101] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.132101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.132101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.132285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.132285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.132420] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.132514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.132573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.132722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.132793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.132885] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 is going to be updated. [ 882.168802] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.168940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.169016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.169244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.169386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.179270] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 in Status: IN_PROGRESS for 2s [ 882.182822] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.182998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.183082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.183291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.183382] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.183567] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.183664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.183726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.183877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.183950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.184055] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de8e111-6e0d-48d0-816d-62134145ea0f is going to be updated. [ 882.211309] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-420 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.211589] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.211684] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.211961] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.212432] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.214104] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.214104] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.214104] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.214104] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.214104] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.214104] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.214104] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.214104] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.214104] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.214104] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.214833] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.219223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.219223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.219223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.219223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.219223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.231668] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de8e111-6e0d-48d0-816d-62134145ea0f in Status: IN_PROGRESS for 2s [ 882.240540] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.240805] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.241065] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.241347] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-420" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.241844] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-6ef1788c-562a-406c-a0fd-695237588e2b taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.242119] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.242294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.242680] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.242904] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ef1788c-562a-406c-a0fd-695237588e2b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.745977] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.746321] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.746437] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.746656] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.746814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.746964] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 6ef1788c-562a-406c-a0fd-695237588e2b not found, creating... [ 882.747248] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.747409] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.747582] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.748071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.748071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.748196] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.748358] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.748487] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.748702] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.748842] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.748988] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 6ef1788c-562a-406c-a0fd-695237588e2b is going to be created. [ 882.777413] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.777859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.778156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.778540] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.778893] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.779352] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.359115] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 in Status: SUCCESS [ 883.359115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.651429] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: SUCCESS [ 883.651646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.651825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.652079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.652278] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.652399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.652465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.652620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.652755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.652873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.652969] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.715561] env[69219]: INFO networking_nsxv3.common.synchronization [req-2b37128c-5974-4221-8d82-29dfc63bdf92 req-ce0f5321-94d3-487c-b4ab-69241428cb36 service nova] Enqueued Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_rules [ 883.715792] env[69219]: INFO networking_nsxv3.common.synchronization [req-2b37128c-5974-4221-8d82-29dfc63bdf92 req-ce0f5321-94d3-487c-b4ab-69241428cb36 service nova] Enqueued Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_members [ 883.715958] env[69219]: INFO networking_nsxv3.common.synchronization [req-2b37128c-5974-4221-8d82-29dfc63bdf92 req-ce0f5321-94d3-487c-b4ab-69241428cb36 service nova] Enqueued Resource ID: 6ef1788c-562a-406c-a0fd-695237588e2b with Priority: HIGHEST for action port [ 883.716545] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_rules [ 883.716687] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_members [ 883.716789] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef1788c-562a-406c-a0fd-695237588e2b with Priority: HIGHEST for action port [ 883.718180] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.718314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.718389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.718608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.718699] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.720574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.720729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.720815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.721486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.721684] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.721854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.721951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.722156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.722243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.722342] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.723246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ef1788c-562a-406c-a0fd-695237588e2b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.723395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.723454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.723569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.723670] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ef1788c-562a-406c-a0fd-695237588e2b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.157367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.157683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.157683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.158017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.158288] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.158467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.158609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.158811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.158998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.159158] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.159375] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.160188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.160321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.160548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.160806] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.161008] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.161164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.162856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.162885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.163354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.163354] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.189468] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 in Status: SUCCESS [ 884.189699] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 deletion is rescheduled due to dependency. [ 884.189854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.221501] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.221673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.225128] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.226258] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ef1788c-562a-406c-a0fd-695237588e2b with status ACTIVE [ 884.226533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.226707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.226815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.227094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.227203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.227509] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.227670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.227758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.227917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.228028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.229067] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.229330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.229400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.229624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.229828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.229954] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ef1788c-562a-406c-a0fd-695237588e2b is going to be updated. [ 884.243850] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1de8e111-6e0d-48d0-816d-62134145ea0f in Status: SUCCESS [ 884.244197] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1de8e111-6e0d-48d0-816d-62134145ea0f deletion is rescheduled due to dependency. [ 884.244396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.255654] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.255801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.255873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.256117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.256259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.256425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ef1788c-562a-406c-a0fd-695237588e2b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.274073] env[69219]: INFO networking_nsxv3.common.synchronization [req-b8337e50-41a0-4fca-9c2d-8aa8720ebd75 req-8344b3d4-2057-4592-b2c3-630fb5e1f676 tempest-ServersNegativeTestMultiTenantJSON-1811841365 tempest-ServersNegativeTestMultiTenantJSON-1811841365-project-member] Enqueued Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_members [ 884.274611] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_members [ 884.274922] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.275055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.275125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.275373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.275538] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.275642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.275705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.275860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.275944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.276261] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.666937] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee58207b-f6f5-4d2a-b0d7-fb2dc440c630: rpc.has_security_group_logging(os_id): False [ 884.689868] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.690216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.690294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.690555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.690763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.690954] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.691112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.691205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.691388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.691493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.691723] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.691822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.691909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.692371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.692475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.692685] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.692837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.692837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.693012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.693121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.693458] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be created. [ 884.732672] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.754048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.754048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.754048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.754048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.754048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.765077] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: IN_PROGRESS for 2s [ 884.778536] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.778699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.778768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.778993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.779093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.779300] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.779436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.779492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.779646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.779725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.779811] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 already deleted. [ 884.779898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.879161] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-311 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.879390] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-311" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.879524] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-311" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.879904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-311" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.880978] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.881234] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.881541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.881670] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.881949] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.882328] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.882464] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.882662] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.882893] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.883108] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.886515] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.886515] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.927422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.927773] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.928134] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.928423] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-311" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.929060] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-19e1da74-aa1a-4dee-8401-b2f582947371 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.929246] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.929429] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.929891] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.930071] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19e1da74-aa1a-4dee-8401-b2f582947371',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.235109] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.235402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.235402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.235629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.235733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.235858] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 is going to be created. [ 885.264464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.264635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.264673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.264884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.265036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.275024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 in Status: UNINITIALIZED for 2s [ 885.433197] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.433469] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.433664] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.433951] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.434132] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.434327] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 19e1da74-aa1a-4dee-8401-b2f582947371 not found, creating... [ 885.434610] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.434801] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.434895] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.435130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.435290] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.435564] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.435822] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.435887] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.436594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.436863] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.436918] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 19e1da74-aa1a-4dee-8401-b2f582947371 is going to be created. [ 885.458587] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.458815] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.458944] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.459249] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.459486] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.459825] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.353316] env[69219]: INFO networking_nsxv3.common.synchronization [req-b8337e50-41a0-4fca-9c2d-8aa8720ebd75 req-f66f53dc-0ce7-479a-8284-d672eb1eeb1f service nova] Enqueued Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_rules [ 886.353597] env[69219]: INFO networking_nsxv3.common.synchronization [req-b8337e50-41a0-4fca-9c2d-8aa8720ebd75 req-f66f53dc-0ce7-479a-8284-d672eb1eeb1f service nova] Enqueued Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_members [ 886.353667] env[69219]: INFO networking_nsxv3.common.synchronization [req-b8337e50-41a0-4fca-9c2d-8aa8720ebd75 req-f66f53dc-0ce7-479a-8284-d672eb1eeb1f service nova] Enqueued Resource ID: 19e1da74-aa1a-4dee-8401-b2f582947371 with Priority: HIGHEST for action port [ 886.354268] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_rules [ 886.354410] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_members [ 886.354508] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e1da74-aa1a-4dee-8401-b2f582947371 with Priority: HIGHEST for action port [ 886.354789] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.354909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.354972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.357986] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.357986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.357986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.357986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.357986] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.358519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-19e1da74-aa1a-4dee-8401-b2f582947371 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.358519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.358519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.359098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.359098] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19e1da74-aa1a-4dee-8401-b2f582947371',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.773104] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: SUCCESS [ 886.773104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.860609] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.864175] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.864175] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19e1da74-aa1a-4dee-8401-b2f582947371 with status ACTIVE [ 886.864175] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.864175] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.864175] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.864175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.864850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.864850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.865090] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19e1da74-aa1a-4dee-8401-b2f582947371 is going to be updated. [ 886.884983] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.884983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.884983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.884983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.884983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.884983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19e1da74-aa1a-4dee-8401-b2f582947371" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.284456] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 in Status: SUCCESS [ 887.284675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.284897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.285178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.285452] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.285595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.285664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.285816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.285903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.285997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.286099] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.367425] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.788462] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.871052] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.871273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.871363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.871597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.871758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.871883] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 is going to be created. [ 887.895143] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.895143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.895143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.895143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.895143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.904740] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 in Status: UNINITIALIZED for 2s [ 888.290803] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e07acd6-602d-48e1-bdfd-e4378ff72832: rpc.has_security_group_logging(os_id): False [ 888.309425] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.309656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.309766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.310060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.310230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.310517] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.310899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.311014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.311308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.311377] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.311536] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 is going to be created. [ 888.370062] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.370427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.370427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.370507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.370643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.389959] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 in Status: IN_PROGRESS for 2s [ 889.128829] env[69219]: INFO networking_nsxv3.common.synchronization [req-1e9ab51a-f7dd-46dc-a8e2-48f9f85a4add req-8e57d1cb-d88e-4bcf-88cf-c7acdbf9fb3d tempest-VolumesAdminNegativeTest-292929570 tempest-VolumesAdminNegativeTest-292929570-project-member] Enqueued Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_members [ 889.129519] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGHEST for action security_group_members [ 889.129886] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.130075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.130154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.130417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.130654] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.130822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.130913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.131089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.131180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.131279] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.637119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.637119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.637119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.637119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.639818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.639818] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.639818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.639818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.639818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.639818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.639818] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e92a878-87ba-416d-b225-777db5147611 is going to be updated. [ 889.666455] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.666455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.666455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.666455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.666455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.673897] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e92a878-87ba-416d-b225-777db5147611 in Status: IN_PROGRESS for 2s [ 889.739038] env[69219]: INFO networking_nsxv3.common.synchronization [req-a207fd0e-691d-4de0-ab1c-27d1e3687c5d req-81e03cab-61cd-4d73-9212-0c442a659d89 tempest-ServerPasswordTestJSON-791555509 tempest-ServerPasswordTestJSON-791555509-project-member] Enqueued Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_members [ 889.739038] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 with Priority: HIGHEST for action security_group_members [ 889.740062] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e06ed06-d558-4f57-8586-39a8c2f2a293 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.740062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.740062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.740062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.740062] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.740062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.744146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.744391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.744500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.744648] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e06ed06-d558-4f57-8586-39a8c2f2a293',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.913838] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 in Status: SUCCESS [ 889.914064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.914228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.914458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.914653] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.914774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.914992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.914992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.915090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.915581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.915581] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.208797] env[69219]: INFO networking_nsxv3.common.synchronization [req-f0a4892c-84b8-4797-8b54-275bbfc9ca36 req-95388f21-d307-4be4-83ed-aec6603a383c tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 890.208797] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 890.209115] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.209244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.213025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.213025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.213025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.213025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.213025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.213025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.213025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.213025] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.247071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.247251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.247300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.247522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.247618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.247827] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.247924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.247987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.248176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.248254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.248342] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 is going to be updated. [ 890.273406] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.273700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.273700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.273821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.273971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.281957] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 in Status: IN_PROGRESS for 2s [ 890.405452] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 in Status: SUCCESS [ 890.405707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.417945] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.417945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.417945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.417945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.418944] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.418944] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.418944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.419428] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.419428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.419428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.419428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.419654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.419654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.419755] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.714871] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.923664] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3: rpc.has_security_group_logging(os_id): False [ 890.947474] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.947474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.948054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.948430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.948553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.948936] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.949047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.949183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.949279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.949869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.949869] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.949869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.949869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.950072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.950072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.950257] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.950361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.950426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.950569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.950996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.950996] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 is going to be created. [ 891.032275] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.032451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.032526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.032719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.032912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.045638] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 in Status: IN_PROGRESS for 2s [ 891.216863] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.682580] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e92a878-87ba-416d-b225-777db5147611 in Status: SUCCESS [ 891.683191] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e92a878-87ba-416d-b225-777db5147611 deletion is rescheduled due to dependency. [ 891.683191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.722483] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.722483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.722483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.722483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.722483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.722483] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 891.759076] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.763864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.763864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.763864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.763864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.774713] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 891.967043] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8a1feb51-2611-4995-aaf6-8d717c6b3682 None None] Enqueued Resource ID: 20a9a4c8-3117-4883-85ba-4e7bf467bb49 with Priority: HIGHEST for action port [ 891.967043] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20a9a4c8-3117-4883-85ba-4e7bf467bb49 with Priority: HIGHEST for action port [ 891.967162] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-20a9a4c8-3117-4883-85ba-4e7bf467bb49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.967248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20a9a4c8-3117-4883-85ba-4e7bf467bb49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.967320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20a9a4c8-3117-4883-85ba-4e7bf467bb49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.967637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20a9a4c8-3117-4883-85ba-4e7bf467bb49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.968149] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20a9a4c8-3117-4883-85ba-4e7bf467bb49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.291737] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 in Status: SUCCESS [ 892.291971] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e06ed06-d558-4f57-8586-39a8c2f2a293 deletion is rescheduled due to dependency. [ 892.292161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e06ed06-d558-4f57-8586-39a8c2f2a293" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.470321] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20a9a4c8-3117-4883-85ba-4e7bf467bb49 [ 892.470561] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.470720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.470817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.471084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.471186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.471302] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20a9a4c8-3117-4883-85ba-4e7bf467bb49 already deleted. [ 892.472178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20a9a4c8-3117-4883-85ba-4e7bf467bb49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.057632] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 in Status: SUCCESS [ 893.058722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.784725] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 893.785893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.915842] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c085f320-d62f-4069-8369-1df7bc3d78ee None None] Enqueued Resource ID: cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7 with Priority: HIGHEST for action port [ 894.916780] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7 with Priority: HIGHEST for action port [ 894.916780] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.917031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.917031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.918229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.918229] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.423502] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7 [ 895.423770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.423942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.424076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.424205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.424294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.424393] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7 already deleted. [ 895.424476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfdbb270-6847-4aad-bf04-b3fbd7c1e7b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.855357] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-a2d6ee31-d9c6-4a86-8b00-97a83bc3172b tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 896.856408] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 896.857619] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.858168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.858261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.858485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.858646] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.858742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.859492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.859492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.859492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.859492] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.168069] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-fd784e30-550e-4b97-93d8-6a6fe87c5174 tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 897.171018] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 897.171018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.171018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.367629] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.367791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.367852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.368177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.368258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.368456] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.368580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.368639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.368799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.368876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.368962] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca already deleted. [ 897.369057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.369220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.369424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.369545] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.369611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.369691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.369836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.369913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.370043] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.476077] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-7098a258-4578-4484-a2cd-7fb219454c56 tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 897.476077] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 897.476077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.476077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.754594] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.754805] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.754929] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.755279] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.755539] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.755791] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.755863] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.756370] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.756602] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.756856] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.757037] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.757240] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.757383] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.757523] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.757686] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.757857] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.777751] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.777929] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 897.778090] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.778273] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.779035] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-4f7194a2-8e6c-4281-9113-073506e26f77 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.779035] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.779035] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.779383] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.779426] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f7194a2-8e6c-4281-9113-073506e26f77',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.873458] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.873772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.873772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.873975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.874089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.874299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.874402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.874461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.874611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.874685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.874770] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca already deleted. [ 897.874850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.875722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.875722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.875722] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.875722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.875722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.875722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.875722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.875994] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.970061] env[69219]: INFO networking_nsxv3.common.synchronization [req-94753d5f-1c61-43a9-b2e5-0001ff8cb379 req-46726f0a-519d-4d51-b517-eade33690a7d tempest-ListImageFiltersTestJSON-2006389702 tempest-ListImageFiltersTestJSON-2006389702-project-member] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 897.970061] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 897.970448] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.970448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.970448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.970645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.970821] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.971021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.971092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.971243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.971327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.971416] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.282023] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.282300] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.282434] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.282720] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.282874] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.283045] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 4f7194a2-8e6c-4281-9113-073506e26f77 not found, creating... [ 898.283315] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.283470] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.283587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.283809] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.283951] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.284245] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.284456] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.284621] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.284706] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.284840] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.284979] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 4f7194a2-8e6c-4281-9113-073506e26f77 is going to be created. [ 898.305050] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.305050] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.305050] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.305050] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.305315] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.305362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.380535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.380789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.380867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.381107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.381197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.381402] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.381502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.381569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.381750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.381833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.381916] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca already deleted. [ 898.381999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.473982] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.980442] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.032920] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-47b664cd-88a4-475b-90f1-32743617a1d9 service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 899.033248] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-47b664cd-88a4-475b-90f1-32743617a1d9 service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 899.033489] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-47b664cd-88a4-475b-90f1-32743617a1d9 service nova] Enqueued Resource ID: 4f7194a2-8e6c-4281-9113-073506e26f77 with Priority: HIGHEST for action port [ 899.034146] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 899.034426] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 899.034512] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7194a2-8e6c-4281-9113-073506e26f77 with Priority: HIGHEST for action port [ 899.034733] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.034896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.034956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.035638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.035724] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.036597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.036714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.036780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.037099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.037503] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.037621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.037703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.037854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.038730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.038841] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.039976] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f7194a2-8e6c-4281-9113-073506e26f77 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.039976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.040071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.040211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.040286] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f7194a2-8e6c-4281-9113-073506e26f77',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.485576] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.485742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.485816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.487252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.487252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.487252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be updated. [ 899.512695] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.512838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.512911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.513146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.513960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.521789] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 2s [ 899.542430] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.542586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.542726] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.543582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f7194a2-8e6c-4281-9113-073506e26f77 with status ACTIVE [ 899.543781] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.543906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.543970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.544192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.544295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.544447] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.544576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.544620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.544743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.544789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.544967] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.546411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.546411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.546411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.546411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.546411] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f7194a2-8e6c-4281-9113-073506e26f77 is going to be updated. [ 899.566751] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.566751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.566751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.566751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.566751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.566751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f7194a2-8e6c-4281-9113-073506e26f77" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.591325] env[69219]: INFO networking_nsxv3.common.synchronization [req-d12b36c3-9c65-4bbd-9a2a-5e45615278c1 req-54b78e52-c996-4bd1-8cf5-c94f717e68d8 tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 899.591465] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 899.595660] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.596025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.596083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.597226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.597226] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.597226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.597226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.597226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.597226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.597226] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.916757] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.917443] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.917443] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.917539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.917796] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.918687] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.918687] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.918687] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.918687] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.918687] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.919828] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.919828] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.919828] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.919828] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.919828] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.919828] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.938123] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.938299] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.938448] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.938615] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.938925] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-883cc2c1-cb11-4397-a0d1-9beffbafff5e taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.939115] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.939252] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.939582] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.939897] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883cc2c1-cb11-4397-a0d1-9beffbafff5e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.954243] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.954442] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-602" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.954570] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-602" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.955196] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-602" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.955495] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.955662] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.955806] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.956015] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.956669] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.958053] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.958053] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.958053] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.958053] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.958053] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.958053] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.958053] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.974693] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.974877] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.975035] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.975226] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-602" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.975547] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c1327720-18cf-45f0-8d91-2e474605ab87 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.975722] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.975844] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.976200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.976345] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1327720-18cf-45f0-8d91-2e474605ab87',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.048678] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.103288] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.103288] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.103288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.103288] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be deleted. [ 900.152436] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.152436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.152436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.152436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.152436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.152436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.443072] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.445346] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 883cc2c1-cb11-4397-a0d1-9beffbafff5e not found, creating... [ 900.445346] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.445346] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.445814] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.445814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.445814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.445814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.445814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.445950] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 883cc2c1-cb11-4397-a0d1-9beffbafff5e is going to be created. [ 900.466029] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.467029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.467029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.467029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.467029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.467222] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.479513] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.479732] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.479859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.480160] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.480312] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.480468] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c1327720-18cf-45f0-8d91-2e474605ab87 not found, creating... [ 900.480727] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.480890] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.483079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.483382] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.483537] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.483844] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.484038] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.485279] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.487458] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.487628] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.487785] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c1327720-18cf-45f0-8d91-2e474605ab87 is going to be created. [ 900.506421] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.506634] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.506757] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.508278] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.508638] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.510134] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.550513] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.550702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.550805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.551039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.551132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.551234] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be created. [ 900.600352] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.600513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.600585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.600850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.601044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.616713] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: UNINITIALIZED for 2s [ 900.617659] env[69219]: INFO networking_nsxv3.common.synchronization [req-906f64eb-7295-4e86-9c25-a0d5c8874dab req-3dd05373-b264-47f7-b521-3d336d1c5a7e tempest-ServersNegativeTestMultiTenantJSON-1811841365 tempest-ServersNegativeTestMultiTenantJSON-1811841365-project-member] Enqueued Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_members [ 900.619548] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGHEST for action security_group_members [ 900.619900] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.623015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.623015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.623015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.623015] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.623015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.623015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.623015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.623015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.623015] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.125669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.125948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.125948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.126106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.126214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.126386] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.126486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.126548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.126694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.126775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.126861] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 is going to be updated. [ 901.152019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.152182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.152249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.152455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.152613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.160744] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 in Status: IN_PROGRESS for 2s [ 901.181736] env[69219]: INFO networking_nsxv3.common.synchronization [req-d12b36c3-9c65-4bbd-9a2a-5e45615278c1 req-22ab66d7-6eec-4f85-8d7e-f58c04d49295 service nova] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_rules [ 901.181820] env[69219]: INFO networking_nsxv3.common.synchronization [req-d12b36c3-9c65-4bbd-9a2a-5e45615278c1 req-22ab66d7-6eec-4f85-8d7e-f58c04d49295 service nova] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 901.181969] env[69219]: INFO networking_nsxv3.common.synchronization [req-d12b36c3-9c65-4bbd-9a2a-5e45615278c1 req-22ab66d7-6eec-4f85-8d7e-f58c04d49295 service nova] Enqueued Resource ID: 883cc2c1-cb11-4397-a0d1-9beffbafff5e with Priority: HIGHEST for action port [ 901.182143] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_rules [ 901.182314] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 901.182382] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 883cc2c1-cb11-4397-a0d1-9beffbafff5e with Priority: HIGHEST for action port [ 901.182975] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.183147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.183205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.183401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.183482] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.184331] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.185019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.185112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.185292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.185439] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.185540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.185601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.185742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.185850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.186212] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.188699] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-883cc2c1-cb11-4397-a0d1-9beffbafff5e taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.188821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.188919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.189102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.189180] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('883cc2c1-cb11-4397-a0d1-9beffbafff5e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.296492] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-cc955373-c9e0-4575-9681-3e95c22d90e5 service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 901.296492] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-cc955373-c9e0-4575-9681-3e95c22d90e5 service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 901.296492] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-cc955373-c9e0-4575-9681-3e95c22d90e5 service nova] Enqueued Resource ID: c1327720-18cf-45f0-8d91-2e474605ab87 with Priority: HIGHEST for action port [ 901.296492] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 901.296492] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 901.296492] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1327720-18cf-45f0-8d91-2e474605ab87 with Priority: HIGHEST for action port [ 901.296849] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.296963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.297187] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.301026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.301026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1327720-18cf-45f0-8d91-2e474605ab87 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.301026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.301026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.301026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.301026] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1327720-18cf-45f0-8d91-2e474605ab87',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.531661] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 4s [ 901.690737] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.692318] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.692431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.692606] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 883cc2c1-cb11-4397-a0d1-9beffbafff5e with status ACTIVE [ 901.692775] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.692883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.692948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.693171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.693259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.693434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.693529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.693588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.693732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.693806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.693988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.694110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.694153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.694307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.694382] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.694467] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 883cc2c1-cb11-4397-a0d1-9beffbafff5e is going to be updated. [ 901.715977] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.715977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.715977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.716166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.716200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.716345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-883cc2c1-cb11-4397-a0d1-9beffbafff5e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.800023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1327720-18cf-45f0-8d91-2e474605ab87 with status ACTIVE [ 901.800213] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.800350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.800416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.800630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.800718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.800916] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.801040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.801098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.803024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.803024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.803024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.803024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.803024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.803024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.803024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.803024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1327720-18cf-45f0-8d91-2e474605ab87 is going to be updated. [ 901.829135] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.829327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.829409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.829628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.830962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.831225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1327720-18cf-45f0-8d91-2e474605ab87" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.120029] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.120029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.120029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.120251] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.120511] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.120676] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.120795] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.124056] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.124296] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.124523] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.124650] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.124770] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.124887] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.125008] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.125124] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.125266] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.143441] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.143711] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.143794] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.146110] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-737" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.146110] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-a1cfd771-583d-40f4-a486-fe1ad64df079 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.146110] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.146110] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.146110] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.146110] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1cfd771-583d-40f4-a486-fe1ad64df079',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.196951] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.628984] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 902.629272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.629478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.629807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.630044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.630198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.630271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.630430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.630512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.630597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.630705] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.631853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.631853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.632025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.632133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.632200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.632342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.632421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.632513] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.648320] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.648581] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.648722] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.648995] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.649597] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.649597] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port a1cfd771-583d-40f4-a486-fe1ad64df079 not found, creating... [ 902.649829] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.650066] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.650212] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.650465] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.650680] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.651051] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.651237] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.651361] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.651615] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.651732] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.652194] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: a1cfd771-583d-40f4-a486-fe1ad64df079 is going to be created. [ 902.672410] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.672779] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.672932] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.673380] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.673748] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.674140] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.699094] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.699311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.699311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.699535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.699619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.699771] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be created. [ 902.721559] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.721816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.721816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.722113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.722295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.731440] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: UNINITIALIZED for 2s [ 903.134143] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.134275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.134408] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.168429] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 in Status: SUCCESS [ 903.168713] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 deletion is rescheduled due to dependency. [ 903.168713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.383529] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-3a9e5c8b-6282-4b4b-a1e3-ae277c30b70c service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 903.383721] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-3a9e5c8b-6282-4b4b-a1e3-ae277c30b70c service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 903.383864] env[69219]: INFO networking_nsxv3.common.synchronization [req-1dfd712f-84b9-49d7-b846-e73bdd007714 req-3a9e5c8b-6282-4b4b-a1e3-ae277c30b70c service nova] Enqueued Resource ID: a1cfd771-583d-40f4-a486-fe1ad64df079 with Priority: HIGHEST for action port [ 903.384113] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 903.384639] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 903.384639] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1cfd771-583d-40f4-a486-fe1ad64df079 with Priority: HIGHEST for action port [ 903.384904] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.385019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.386464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.386464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.386464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1cfd771-583d-40f4-a486-fe1ad64df079 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.386464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.386464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.386464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.386464] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1cfd771-583d-40f4-a486-fe1ad64df079',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.541344] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 903.541951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.637431] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.890419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1cfd771-583d-40f4-a486-fe1ad64df079 with status ACTIVE [ 903.890738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.890951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.891010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.891209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.891302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.891485] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.891581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.891644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.891833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.891929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.892158] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.892261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.892320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.892461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.892535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.892621] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1cfd771-583d-40f4-a486-fe1ad64df079 is going to be updated. [ 903.913903] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.914060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.914137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.914338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.914474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.914632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1cfd771-583d-40f4-a486-fe1ad64df079" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.140024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.140360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.140360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.140445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.140476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.140596] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 904.176926] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.176926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.176926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.176926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.176926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.186726] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 904.739999] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 904.740228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.740387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.740614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.740790] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.740909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.740981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.741206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.741206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.741293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.741386] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.247542] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.247895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.247895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.248053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.248276] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.248437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.248552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.248697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.248822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.248926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.249120] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.249260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.249341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.249494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.249640] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.249751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.249812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.249952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.250041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.250126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.250213] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.753607] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 825c0c18-33c1-4cb4-8480-e8d82499bbf3: rpc.has_security_group_logging(os_id): False [ 905.770734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.771040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.771130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.771355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.771448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.772079] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.772079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.772079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.772520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.772520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.772520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.772678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.772678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.772678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.772929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.772977] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.773988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.774265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.774265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.774370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.774852] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be created. [ 905.829444] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.829592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.829664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.829940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.830155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.839199] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 906.198418] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 906.198690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.198909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.199066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.199264] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.199404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.199486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.199716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.199865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.200063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.200142] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.200225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.200287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.200461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.200559] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.200839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.200839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.200893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.200935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.201022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.201126] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.202357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.202357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.202448] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.202623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.202623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.202759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.202829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.202910] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.704712] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdacd70-c14b-4dd0-9cba-de8872db32ca: rpc.has_security_group_logging(os_id): False [ 906.706509] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.722211] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.722367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.722438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.722681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.722740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.722931] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.723042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.723103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.723276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.723327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.723511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.723603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.723662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.723800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.723876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.724075] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.724173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.724224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.724364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.724431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.724514] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be created. [ 906.777986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.778140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.778186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.779015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.779015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.789485] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 907.208879] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.714522] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.714831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.714916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.715303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.715453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.716155] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 907.745787] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.745787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.745787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.746111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.746111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.753968] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 907.852500] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 907.853254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.386547] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 908.386547] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 908.801183] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 908.801596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.801672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.801928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.802040] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.304701] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.304870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.765541] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 909.765952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.766115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.766512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.766780] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.766946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.767057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.767302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.767431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.767564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.767701] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.272536] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.272815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.272815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.272956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.273136] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.273251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.273296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.273449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.273533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.273615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.273759] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.273873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.273905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.274030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.274170] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.274259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.274318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.274450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.274523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.274603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.274692] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.320957] env[69219]: INFO networking_nsxv3.common.synchronization [req-30209377-7021-42c1-a20b-33881798304f req-9ff7d3e8-1a99-4bb1-ad68-183c30f572b4 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_members [ 910.321543] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_members [ 910.321890] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.322091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.322227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.322519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.322719] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.322852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.323207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.323207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.323207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.323454] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.761859] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.761975] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.763017] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.763017] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.763017] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.763017] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.763017] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.763256] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.763306] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.763516] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.763629] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.763746] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.763859] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.763966] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.764082] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.764214] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.777615] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdacd70-c14b-4dd0-9cba-de8872db32ca: rpc.has_security_group_logging(os_id): False [ 910.782916] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.782916] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.783069] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.783491] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.783839] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.784029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.784555] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.784555] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.784664] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f61da8-d0fd-45b9-96f8-d546b0c2cb83',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.794172] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.794355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.794453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.794694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.794802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.795055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.795168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.795220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.795449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.795746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.796814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.797624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.797624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.797624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.797624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.797864] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.798098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.798098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.798227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.798268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.798413] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 910.825510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.825510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.825510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.825711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.825711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.826077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.826182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.826247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.826407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.826489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.826586] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d already deleted. [ 910.826666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.853985] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.854453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.854650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.854994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.855271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.865977] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 911.291687] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.292169] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.292169] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.292519] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.292741] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.292937] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 not found, creating... [ 911.293298] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.293525] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.293680] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.293960] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.294185] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.294525] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.294774] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.294953] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.295233] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.295432] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.295627] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 is going to be created. [ 911.314630] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.314861] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.314991] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.315308] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.315531] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.315762] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.192716] env[69219]: INFO networking_nsxv3.common.synchronization [req-30209377-7021-42c1-a20b-33881798304f req-2d067ab7-0b14-4f5a-98cd-732a15d83d59 service nova] Enqueued Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_rules [ 912.192716] env[69219]: INFO networking_nsxv3.common.synchronization [req-30209377-7021-42c1-a20b-33881798304f req-2d067ab7-0b14-4f5a-98cd-732a15d83d59 service nova] Enqueued Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_members [ 912.192716] env[69219]: INFO networking_nsxv3.common.synchronization [req-30209377-7021-42c1-a20b-33881798304f req-2d067ab7-0b14-4f5a-98cd-732a15d83d59 service nova] Enqueued Resource ID: a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 with Priority: HIGHEST for action port [ 912.192716] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_rules [ 912.192716] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_members [ 912.192716] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 with Priority: HIGHEST for action port [ 912.192716] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.192716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.192716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.192716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.192716] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.193850] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.193969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.194045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.194232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.194439] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.194527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.194584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.194730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.194812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.195091] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.195706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.195813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.195878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.196052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.196131] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8f61da8-d0fd-45b9-96f8-d546b0c2cb83',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.698642] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.698642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.699012] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.699861] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 with status ACTIVE [ 912.700128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.700260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.700353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.700582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.700702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.700953] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.701075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.701139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.701297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.701488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.701564] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.701758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.701758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.701869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.701958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.701958] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8f61da8-d0fd-45b9-96f8-d546b0c2cb83 is going to be updated. [ 912.723065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.723065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.723065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.723065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.723065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.723065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8f61da8-d0fd-45b9-96f8-d546b0c2cb83" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.878878] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 912.879125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.879312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.879535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.879621] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.095478] env[69219]: INFO networking_nsxv3.common.synchronization [req-147501c5-36b9-422f-b6df-1fb5b7d09908 req-4d5cf662-479a-423b-ac86-70f26bde59e3 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 913.101586] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 913.102255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.102380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.105612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.105612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.105612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.105612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.105612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.105612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.105612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.105612] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.204754] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.382514] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.382707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.382783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.383030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.383208] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.383306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.383368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.383516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.383929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.383929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.383929] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.605847] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.696643] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-587 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.696860] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.696991] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.697302] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.697593] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.697783] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.697944] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.700452] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.700693] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.701050] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.701374] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.701562] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.701728] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.701894] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.702070] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.702987] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.709019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.709155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.709225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.709408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.709494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.709585] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d is going to be created. [ 913.725914] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.726151] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.726305] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.726480] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-587" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.726795] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-65598cc5-998b-4108-8bd9-b06d4f75c1e1 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.726973] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.727534] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.727888] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.728134] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65598cc5-998b-4108-8bd9-b06d4f75c1e1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.732543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.732672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.732739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.732937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.733157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.740951] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d in Status: UNINITIALIZED for 2s [ 913.886112] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.886291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.886336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.886581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.886758] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.886857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.886922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.887089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.887180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.887270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.887416] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.887507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.887565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.887714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.887921] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.888028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.888088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.888226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.888299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.888379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.888468] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.112918] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.230809] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.231319] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.231591] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.232047] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.232275] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.232494] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 65598cc5-998b-4108-8bd9-b06d4f75c1e1 not found, creating... [ 914.233650] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.233846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.233975] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.234246] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.234420] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.234858] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.234977] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.235063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.235289] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.235436] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.235581] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 is going to be created. [ 914.256739] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.256898] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.257016] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.257537] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.257610] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.257849] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.391524] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdacd70-c14b-4dd0-9cba-de8872db32ca: rpc.has_security_group_logging(os_id): False [ 914.412173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.412334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.412407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.412643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.412738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.413058] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.413058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.413348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.413348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.413348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.413535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.413641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.413704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.413856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.413933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.414462] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.414596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.414664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.416354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.416354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.416354] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 914.473028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.473255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.473373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.473671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.473879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.488397] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 914.615428] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.615636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.615695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.615945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.616073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.616174] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 914.654234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.654429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.654532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.654877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.655053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.663527] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 915.161627] env[69219]: INFO networking_nsxv3.common.synchronization [req-147501c5-36b9-422f-b6df-1fb5b7d09908 req-461c0c71-4759-4f8a-ac56-bbd1e8be3f9f service nova] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 915.161900] env[69219]: INFO networking_nsxv3.common.synchronization [req-147501c5-36b9-422f-b6df-1fb5b7d09908 req-461c0c71-4759-4f8a-ac56-bbd1e8be3f9f service nova] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 915.161992] env[69219]: INFO networking_nsxv3.common.synchronization [req-147501c5-36b9-422f-b6df-1fb5b7d09908 req-461c0c71-4759-4f8a-ac56-bbd1e8be3f9f service nova] Enqueued Resource ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with Priority: HIGHEST for action port [ 915.162203] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 915.162357] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 915.162478] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with Priority: HIGHEST for action port [ 915.165618] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.165715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.166990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.166990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.166990] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.167487] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.168449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.168449] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-65598cc5-998b-4108-8bd9-b06d4f75c1e1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.168449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.168449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.168449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.168449] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65598cc5-998b-4108-8bd9-b06d4f75c1e1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.673648] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.673837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.674132] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with status ACTIVE [ 915.674340] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.674624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.674624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.674782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.674858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.675057] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.675164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.675227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.675412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.675498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.675680] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.676165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.676165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.676165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.676165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.676165] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 is going to be updated. [ 915.703786] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.703953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.704011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.704334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.704403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.704557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.755746] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d in Status: SUCCESS [ 915.755856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.756092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.756358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.756560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.756682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.756752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.756901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.757070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.757070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.757208] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.994272] env[69219]: INFO networking_nsxv3.common.synchronization [req-326c15c6-cb16-4cf7-9dba-e18eb47435cc req-874d62e9-c6c5-4d06-af57-c5352051702d tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 915.994813] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 915.995170] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.995297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.995366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.995574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.995727] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.995819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.995877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.996044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.996200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.996305] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.259385] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.502647] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.502918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.502918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.503154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.503237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.503496] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.503609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.503676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.503919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.504017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.504638] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 916.506265] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 916.506472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.529606] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.530341] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.530341] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.530490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.530823] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.530940] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.531139] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.531427] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.531586] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.531802] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.531921] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.532042] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.532187] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.532336] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.532457] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.532598] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.541882] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.541882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.542078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.542740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.542740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.557753] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 916.558194] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.558352] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 916.558495] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.558670] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.558982] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-1d9ae834-9e01-447b-9f80-0fc714a06fe2 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.559177] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.559302] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.559639] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.559813] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d9ae834-9e01-447b-9f80-0fc714a06fe2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.673240] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 916.673539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.673711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.673947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.674150] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.674271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.674339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.674494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.674569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.674668] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.761754] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5e5bd65-43e8-43dd-ba51-515caef2f24d: rpc.has_security_group_logging(os_id): False [ 916.778391] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.778692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.778692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.778817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.778980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.783024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.783024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.783024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.783024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.783024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.783024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d is going to be created. [ 916.834807] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.834807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.834807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.834807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.834807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.846324] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d in Status: IN_PROGRESS for 2s [ 917.064143] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.064527] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.064707] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.065162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.065379] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.065599] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 1d9ae834-9e01-447b-9f80-0fc714a06fe2 not found, creating... [ 917.065941] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.066180] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.066362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.066646] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.066840] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.068067] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.068249] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.068466] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.068764] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.069083] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.069272] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 1d9ae834-9e01-447b-9f80-0fc714a06fe2 is going to be created. [ 917.089236] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.089525] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.089691] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.090031] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.090263] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.090484] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.177205] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.679536] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.182360] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.182653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.182771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.183058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.183232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.183365] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 918.216690] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.216857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.216896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.217121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.217267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.226894] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 918.331896] env[69219]: INFO networking_nsxv3.common.synchronization [req-326c15c6-cb16-4cf7-9dba-e18eb47435cc req-6245f06a-8e69-4edc-a74d-c49988c01a9c service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 918.333906] env[69219]: INFO networking_nsxv3.common.synchronization [req-326c15c6-cb16-4cf7-9dba-e18eb47435cc req-6245f06a-8e69-4edc-a74d-c49988c01a9c service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 918.333906] env[69219]: INFO networking_nsxv3.common.synchronization [req-326c15c6-cb16-4cf7-9dba-e18eb47435cc req-6245f06a-8e69-4edc-a74d-c49988c01a9c service nova] Enqueued Resource ID: 1d9ae834-9e01-447b-9f80-0fc714a06fe2 with Priority: HIGHEST for action port [ 918.333906] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 918.333906] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 918.333906] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d9ae834-9e01-447b-9f80-0fc714a06fe2 with Priority: HIGHEST for action port [ 918.333906] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.333906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.333906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.333906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.333906] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.335840] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.335840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.335840] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d9ae834-9e01-447b-9f80-0fc714a06fe2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.335840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.335840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.335840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.335840] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d9ae834-9e01-447b-9f80-0fc714a06fe2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.554586] env[69219]: INFO networking_nsxv3.common.synchronization [req-9837b1f0-46fc-408e-9d67-0c664efd933e req-b6f12eeb-da71-4c41-975b-1d6ef711d247 tempest-ListServerFiltersTestJSON-897971295 tempest-ListServerFiltersTestJSON-897971295-project-member] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 918.555123] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 918.555432] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.555556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.555624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.555880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.556712] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.556898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.557020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.557238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.557378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.557540] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.568938] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 918.569377] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d deletion is rescheduled due to dependency. [ 918.569377] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.569694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.569962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.570145] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.570254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.570320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.570481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.570560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.570658] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.728205] env[69219]: INFO networking_nsxv3.common.synchronization [req-a1f55e6e-01df-4a95-90e5-4d67049bc680 req-00ccc156-a06a-4209-b19e-4a8cfb38b29c tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 918.729646] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 918.732223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.732223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.732223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.732223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.732223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.732223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.732223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.732223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.732223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.732223] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.838486] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.838486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.843152] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d9ae834-9e01-447b-9f80-0fc714a06fe2 with status ACTIVE [ 918.846392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.846392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.846392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.846392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.846392] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d9ae834-9e01-447b-9f80-0fc714a06fe2 is going to be updated. [ 918.862776] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d in Status: SUCCESS [ 918.862776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.871927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.872153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.872225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.872436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.872579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.872725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d9ae834-9e01-447b-9f80-0fc714a06fe2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.914368] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.914553] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.914668] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.915077] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.915354] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.915519] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.915642] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.915865] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.916035] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.917351] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.917351] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.917351] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.917351] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.917351] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.917351] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.917351] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.941021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.941537] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 918.941924] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.942187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.942557] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-a31f935c-089c-4435-aeb7-575724c9ee70 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.942919] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.942919] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.943356] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.943515] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a31f935c-089c-4435-aeb7-575724c9ee70',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.041024] env[69219]: INFO networking_nsxv3.common.synchronization [req-a1f55e6e-01df-4a95-90e5-4d67049bc680 req-bdde4d80-a6b1-4b08-b1de-95ad236af448 tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 919.041024] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 919.041522] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.041755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.062990] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.062990] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.062990] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 already deleted. [ 919.062990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.076466] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.232709] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.356384] env[69219]: INFO networking_nsxv3.common.synchronization [req-a1f55e6e-01df-4a95-90e5-4d67049bc680 req-1e5c0588-53dc-4d58-97a1-03b916be5076 tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 919.356525] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 919.356789] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.356882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.448490] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.448490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.448490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.448490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.448490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.448490] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port a31f935c-089c-4435-aeb7-575724c9ee70 not found, creating... [ 919.448490] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.448490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.448490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.449258] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.449588] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.450268] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.450952] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.451306] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.451904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.452223] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.452625] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: a31f935c-089c-4435-aeb7-575724c9ee70 is going to be created. [ 919.474887] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.475110] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.475262] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.475668] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.475908] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.476262] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.577936] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.734976] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.080145] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.080328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.080420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.080651] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.080745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.080846] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 920.107552] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.107750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.107956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.108210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.108371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.116522] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 920.171539] env[69219]: INFO networking_nsxv3.common.synchronization [req-9837b1f0-46fc-408e-9d67-0c664efd933e req-136b2093-5d48-4398-a7a8-8b18af618a77 service nova] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_rules [ 920.171775] env[69219]: INFO networking_nsxv3.common.synchronization [req-9837b1f0-46fc-408e-9d67-0c664efd933e req-136b2093-5d48-4398-a7a8-8b18af618a77 service nova] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 920.172029] env[69219]: INFO networking_nsxv3.common.synchronization [req-9837b1f0-46fc-408e-9d67-0c664efd933e req-136b2093-5d48-4398-a7a8-8b18af618a77 service nova] Enqueued Resource ID: a31f935c-089c-4435-aeb7-575724c9ee70 with Priority: HIGHEST for action port [ 920.172655] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_rules [ 920.172795] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 920.172895] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31f935c-089c-4435-aeb7-575724c9ee70 with Priority: HIGHEST for action port [ 920.173315] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.173444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.173509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.173767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.175876] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.175876] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.175876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.175876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.175876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.175876] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.175876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.175876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.175876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.175876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.175876] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.176452] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-a31f935c-089c-4435-aeb7-575724c9ee70 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.176570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.176626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.176765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.176907] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a31f935c-089c-4435-aeb7-575724c9ee70',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.237696] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 920.237696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.237696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.237696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.237696] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.237696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.237696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.237970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.237970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.237970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.238081] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.242142] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.242290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.242361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.242563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.242652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.242744] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 920.272269] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.272383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.272437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.272618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.272760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.280764] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 920.680879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.681052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.681264] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.684344] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a31f935c-089c-4435-aeb7-575724c9ee70 with status ACTIVE [ 920.684623] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.685051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.685137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.685390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.685545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.685769] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.685975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.686093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.686290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.686414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.686720] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.686948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.687034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.687163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.687417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.687417] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a31f935c-089c-4435-aeb7-575724c9ee70 is going to be updated. [ 920.711662] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.711857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.711891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.714506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.714506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.714506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a31f935c-089c-4435-aeb7-575724c9ee70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.749424] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.749728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.749728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.749960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.750150] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.750253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.750314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.750469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.750549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.750633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.750775] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.750941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.750941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.751076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.751210] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.751294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.751349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.751480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.751550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.751627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.751709] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.191064] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.255029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd: rpc.has_security_group_logging(os_id): False [ 921.274149] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.275484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.275484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.275484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.296371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.296676] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.296805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.296874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.297097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.297184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.297437] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.297653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.297653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.297887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.297965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.298171] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.298280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.298327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.298483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.298566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.298698] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 921.358649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.358649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.358649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.358649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.358649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.369179] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 921.693865] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.694183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.694349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.694640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.694780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.694933] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be created. [ 921.724405] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.724642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.724768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.725115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.725793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.735965] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: UNINITIALIZED for 2s [ 922.130459] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 922.130459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.130459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.130459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.130459] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.130950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.130950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.130950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.130950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.131136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.131183] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.291135] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 922.291381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.291550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.291821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.292035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.292168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.292236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.292421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.292506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.292622] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.640387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.640387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.640387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.640387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.640387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.640938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.640938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.640938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.640938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.640938] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.795405] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.796630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.796630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.798564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.798564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.798564] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.798564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.798564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.798564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.798564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.798564] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 922.829887] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.830127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.832135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.832135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.832135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.841325] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 923.142821] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df327ac5-73cd-478c-b19b-3849894e070d: rpc.has_security_group_logging(os_id): False [ 923.164607] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.164825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.164903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.166450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.166450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.166641] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.167031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.167121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.167309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.167389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.167584] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.167683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.167762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.167913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.167992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.168232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.168333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.168396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.168552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.168632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.168728] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 923.242453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.242662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.242745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.242955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.243120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.259045] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 923.369431] env[69219]: INFO networking_nsxv3.common.synchronization [req-76203035-1d8b-47ac-a3c0-a9236c57dd1b req-1c0dc744-79a9-4155-88e5-0d3f7fbc54ec tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 923.369431] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 923.369431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.369431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.369431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.369431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.369431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.369431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.369431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.369431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.369431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.369431] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.414219] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 923.414460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.745337] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.749019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.749019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.749019] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.875403] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.875403] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.875403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.875403] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be updated. [ 923.898931] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.898931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.898931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.898931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.898931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.904991] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 924.253125] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.253125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.253125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.253474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.253474] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.253474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.253623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.253798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.253798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.253927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.254017] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.254094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.254935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.254935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.254935] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.254935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.254935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.254935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.254935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.254935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.254935] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.759934] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba38a24c-584a-4fc2-8fc4-91929e372e75: rpc.has_security_group_logging(os_id): False [ 924.778543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.778683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.778753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.778962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.779066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.779256] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.779359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.779421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.779573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.779650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.779902] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.780058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.780100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.780393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.780393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.780481] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.780565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.780623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.780757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.780906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.781097] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be created. [ 924.836044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.836214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.836552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.836717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.838325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.853119] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 924.856031] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca deletion is rescheduled due to dependency. [ 924.856031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.856031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.856031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.856031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.856031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.856031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.856031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.856031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.856031] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.856524] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 925.075638] env[69219]: INFO networking_nsxv3.common.synchronization [req-52046abb-f7dc-4099-9ac8-a59286b95987 req-4f2d6a3d-b15d-4396-90b0-e572fa2fc4a9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 925.075740] env[69219]: INFO networking_nsxv3.common.synchronization [req-52046abb-f7dc-4099-9ac8-a59286b95987 req-4f2d6a3d-b15d-4396-90b0-e572fa2fc4a9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 925.076262] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 925.076396] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 925.076691] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.076833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.076898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.077668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.077668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.077668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.077850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.077890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.079235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.079235] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.079235] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.079235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.079235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.079709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.079709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.079709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.079709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.079709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.080478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.080478] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.139227] env[69219]: INFO networking_nsxv3.common.synchronization [req-52046abb-f7dc-4099-9ac8-a59286b95987 req-4f2d6a3d-b15d-4396-90b0-e572fa2fc4a9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_rules [ 925.139412] env[69219]: INFO networking_nsxv3.common.synchronization [req-52046abb-f7dc-4099-9ac8-a59286b95987 req-4f2d6a3d-b15d-4396-90b0-e572fa2fc4a9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 925.139552] env[69219]: INFO networking_nsxv3.common.synchronization [req-52046abb-f7dc-4099-9ac8-a59286b95987 req-4f2d6a3d-b15d-4396-90b0-e572fa2fc4a9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 925.139685] env[69219]: INFO networking_nsxv3.common.synchronization [req-52046abb-f7dc-4099-9ac8-a59286b95987 req-4f2d6a3d-b15d-4396-90b0-e572fa2fc4a9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 925.139873] env[69219]: INFO networking_nsxv3.common.synchronization [req-52046abb-f7dc-4099-9ac8-a59286b95987 req-4f2d6a3d-b15d-4396-90b0-e572fa2fc4a9 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with Priority: HIGHEST for action port [ 925.140425] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_rules [ 925.140579] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 925.140701] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with Priority: HIGHEST for action port [ 925.140801] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 925.140893] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 925.141757] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.141921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.141990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.142358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.142440] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.143519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.143659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.143714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.144209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.145390] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.151238] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-65598cc5-998b-4108-8bd9-b06d4f75c1e1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.151238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.151238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.151238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.151405] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65598cc5-998b-4108-8bd9-b06d4f75c1e1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.152067] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.152159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.152349] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.152427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.273272] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 925.273562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.358052] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.358241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.358323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.358601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.358716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.358995] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.359168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.359263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.359503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.359562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.359664] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 925.385910] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.386111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.386175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.386394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.386544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.395831] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 925.583477] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.584481] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.654440] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.655814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.655814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.655814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.655814] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with status ACTIVE [ 925.655814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.656084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.657355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.657566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.657725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.657932] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.658092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.658183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.658379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.659395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.659395] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.659395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.659395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.659395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.659395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.659395] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 is going to be updated. [ 925.682022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.682022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.682022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.682022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.682022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.682022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.899430] env[69219]: INFO networking_nsxv3.common.synchronization [req-b69a8fe7-7caf-47d7-b1b0-291b51e836b5 req-24bf986a-1018-48a3-9b91-65c5116795e4 tempest-ListServerFiltersTestJSON-897971295 tempest-ListServerFiltersTestJSON-897971295-project-member] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 925.899430] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 925.899430] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.900519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.900650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.900856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.901096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.901718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.901815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.902079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.902248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.902434] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.921713] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 925.921893] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 deletion is rescheduled due to dependency. [ 925.922019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.086915] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.087467] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.347656] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.347965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.348020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.348531] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.348606] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.348806] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.348949] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.349228] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.349427] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.349675] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.349826] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.350026] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.350149] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.350268] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.350490] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.350600] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.368446] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.368651] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.368817] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.369034] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.369350] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-018a83df-8f4f-4c53-99dc-efe97be42e7e taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.369524] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.369648] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.370031] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.370202] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('018a83df-8f4f-4c53-99dc-efe97be42e7e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.409617] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.589456] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.590626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.590626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.590626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.590626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.590626] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be created. [ 926.591610] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.591743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.591796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.591989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.592087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.592205] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 926.619818] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.620098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.620179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.620388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.620544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.628622] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.628782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.628822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.629015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.629164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.632808] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: UNINITIALIZED for 2s [ 926.636372] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 926.868177] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 926.868177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.873371] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.874107] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.874622] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.876018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.876018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.876018] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 018a83df-8f4f-4c53-99dc-efe97be42e7e not found, creating... [ 926.876018] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.876018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.876018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.876564] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.876833] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.879673] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.879673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.879673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.879673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.879673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.879673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 018a83df-8f4f-4c53-99dc-efe97be42e7e is going to be created. [ 926.898179] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.898540] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.898726] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.899178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.899546] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.899840] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.912416] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.412051] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 927.412051] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca deletion is rescheduled due to dependency. [ 927.412051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.416538] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.416704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.416762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.416999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.417114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.417265] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 927.441383] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.441530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.441530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.442460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.442460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.451039] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 927.697300] env[69219]: INFO networking_nsxv3.common.synchronization [req-b69a8fe7-7caf-47d7-b1b0-291b51e836b5 req-401de5c4-1731-49a2-9975-c1b0da5939c8 service nova] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_rules [ 927.697489] env[69219]: INFO networking_nsxv3.common.synchronization [req-b69a8fe7-7caf-47d7-b1b0-291b51e836b5 req-401de5c4-1731-49a2-9975-c1b0da5939c8 service nova] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 927.697632] env[69219]: INFO networking_nsxv3.common.synchronization [req-b69a8fe7-7caf-47d7-b1b0-291b51e836b5 req-401de5c4-1731-49a2-9975-c1b0da5939c8 service nova] Enqueued Resource ID: 018a83df-8f4f-4c53-99dc-efe97be42e7e with Priority: HIGHEST for action port [ 927.697904] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_rules [ 927.698049] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 927.698162] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018a83df-8f4f-4c53-99dc-efe97be42e7e with Priority: HIGHEST for action port [ 927.698741] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.698848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.698899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.699250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.699335] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.701920] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.701920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.701920] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-018a83df-8f4f-4c53-99dc-efe97be42e7e taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.701920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.701920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.702260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.702260] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('018a83df-8f4f-4c53-99dc-efe97be42e7e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.204315] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.204315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.205931] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 018a83df-8f4f-4c53-99dc-efe97be42e7e with status ACTIVE [ 928.206478] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.206614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.206717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.207058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.207207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.207488] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.207583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.207612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.207963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.207963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.208205] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.208270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.208323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.208510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.208599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.208716] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 018a83df-8f4f-4c53-99dc-efe97be42e7e is going to be updated. [ 928.229152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.230034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.230034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.230034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.230034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.230034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-018a83df-8f4f-4c53-99dc-efe97be42e7e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.645025] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: SUCCESS [ 928.645297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.646029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 928.646199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.646354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.646553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.646737] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.646858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.646939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.647120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.647204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.647294] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.648130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.648309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.648473] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.648577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.648640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.648783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.648901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.649050] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.151186] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.154637] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.460343] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 929.460398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.460590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.460853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.461075] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.461254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.461353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.461550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.461654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.461742] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.653734] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.659082] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.969838] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.157065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.157065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.157065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.157065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.157065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.157419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be updated. [ 930.160982] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.161160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.161268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.161453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.161553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.161647] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 930.187244] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.187431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.187500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.187750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.188057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.189842] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.190051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.190104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.190292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.190423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.199062] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: IN_PROGRESS for 2s [ 930.199753] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 930.472784] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.974527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.975194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.975194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.975194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.975194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.975344] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 931.004916] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.005290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.005290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.005578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.005804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.014999] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 931.037626] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_members [ 931.037626] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 931.037626] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 931.038064] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_members [ 931.038207] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 931.038326] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 931.038620] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04f4d-823f-4a5c-800d-0d26247d20e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.038741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.038809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.039097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.039267] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.039763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.039835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.040046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.040132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.040249] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.041234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.041359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.041598] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.041638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.103309] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_rules [ 931.103824] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 931.104307] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 931.104615] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 931.105355] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_rules [ 931.106352] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_members [ 931.106352] env[69219]: INFO networking_nsxv3.common.synchronization [req-78f1b02b-bb2f-4a2d-a49b-24e5616f0cb2 req-4908adef-af95-4b21-b373-76cf81e0f6b2 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with Priority: HIGHEST for action port [ 931.109612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_rules [ 931.109612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_rules [ 931.109612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_members [ 931.109612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with Priority: HIGHEST for action port [ 931.109612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_rules [ 931.109612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 931.109612] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 931.109612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.109612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.109612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.109612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.109612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04f4d-823f-4a5c-800d-0d26247d20e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.109612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.110247] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-65598cc5-998b-4108-8bd9-b06d4f75c1e1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.110247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.110247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.110374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.110374] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65598cc5-998b-4108-8bd9-b06d4f75c1e1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.111374] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad04f4d-823f-4a5c-800d-0d26247d20e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.111989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.112112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.112352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.112698] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.113376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.113485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.114476] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.114476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.542876] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.615379] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65598cc5-998b-4108-8bd9-b06d4f75c1e1 with status ACTIVE [ 931.615611] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.615755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.615824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.616131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.616232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.616455] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.616561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.616630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.616726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.616803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.616980] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.617089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.617148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.617290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.617364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.617450] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65598cc5-998b-4108-8bd9-b06d4f75c1e1 is going to be updated. [ 931.618823] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04f4d-823f-4a5c-800d-0d26247d20e8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.618939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.641044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.641229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.641485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.641485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.641615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.641780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65598cc5-998b-4108-8bd9-b06d4f75c1e1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.052020] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.213060] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.213060] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.213060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.213060] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.214718] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: SUCCESS [ 932.214946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.215156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.215360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.215548] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.215676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.215741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.216616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.216616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.216616] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.219224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.219424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.219612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.219753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.219820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.220026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.222503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.222733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.222733] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.224599] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.224709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.225085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.225085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.225208] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.225330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.225372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.225532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.225621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.225734] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.555716] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.555967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.555967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.556296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.556447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.556510] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 is going to be created. [ 932.579634] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.579840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.579940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.580811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.581451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.592254] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 in Status: UNINITIALIZED for 2s [ 932.724738] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.728423] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.729240] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.024475] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 933.024684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.024790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.025135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.025382] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.025584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.025702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.026048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.026048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.026139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.026345] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.229035] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.230915] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcba48ed-3f96-4cef-8edf-50ba05bacea8: rpc.has_security_group_logging(os_id): False [ 933.232116] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.253447] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.254599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.254599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.254599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.254599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.254855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.254979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.255057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.255295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.255479] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.255660] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be created. [ 933.311019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.311019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.311019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.311019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.311019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.321174] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: IN_PROGRESS for 2s [ 933.528932] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.529121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.529176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.529410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.529582] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.529684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.529744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.529917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.530035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.530124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.530278] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.530365] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.530428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.530594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.530731] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.530833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.530891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.531041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.531127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.531215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.531302] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.732112] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.732269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.732337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.732563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.732649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.732743] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 933.734071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.736075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.736075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.736075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.736075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.736075] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be updated. [ 933.760751] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.760952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.760952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.761189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.765017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.765017] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.765017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.765017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.765017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.765017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.772497] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 933.773296] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: IN_PROGRESS for 2s [ 934.037028] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba38a24c-584a-4fc2-8fc4-91929e372e75: rpc.has_security_group_logging(os_id): False [ 934.063025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.063025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.063025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.063025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.063636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.063636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.063636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.063819] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.063959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.064049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.064256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.064337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.064427] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 934.139030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.139267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.139390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.139770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.139851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.153625] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 934.612419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 in Status: SUCCESS [ 934.612676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.612815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.613929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.613929] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.613929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.613929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.613929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.613929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.613929] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.988482] env[69219]: INFO networking_nsxv3.common.synchronization [req-0e0da3bb-8976-43ef-b572-389480ff6066 req-388efa28-c4c9-4db4-9f95-b2ceb43f1e2b tempest-ListServerFiltersTestJSON-897971295 tempest-ListServerFiltersTestJSON-897971295-project-member] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 934.988983] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 934.989584] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.989584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.989584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.989744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.989812] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.989939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.990021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.992148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.992268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.992382] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.032715] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c36eb5a1-0256-4f29-ae59-f7cd5afcecdb None None] Enqueued Resource ID: 5342876d-7958-411b-8950-a1807733c36f with Priority: HIGHEST for action port [ 935.032905] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5342876d-7958-411b-8950-a1807733c36f with Priority: HIGHEST for action port [ 935.033505] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-5342876d-7958-411b-8950-a1807733c36f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.033644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5342876d-7958-411b-8950-a1807733c36f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.033701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5342876d-7958-411b-8950-a1807733c36f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.036837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5342876d-7958-411b-8950-a1807733c36f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.036930] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5342876d-7958-411b-8950-a1807733c36f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.118534] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.310661] env[69219]: INFO networking_nsxv3.common.synchronization [req-adb697b9-5c3f-4eaa-adcc-a1795b206d77 req-4fc5c2ae-df71-4639-a291-48c4c549b9e1 tempest-ServerActionsV293TestJSON-1968701766 tempest-ServerActionsV293TestJSON-1968701766-project-member] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_members [ 935.311199] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGHEST for action security_group_members [ 935.311506] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.311627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.311689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.312210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.312403] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.312678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.312678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.312801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.312853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.312921] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.332874] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: SUCCESS [ 935.333153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.333264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.333534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.333534] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.493966] env[69219]: INFO networking_nsxv3.common.synchronization [req-98f9dea8-8b7a-4cfd-bbde-cdc9a46d3926 req-dd0bff11-1dd2-47fd-9682-fe268f4632b8 tempest-VolumesAdminNegativeTest-292929570 tempest-VolumesAdminNegativeTest-292929570-project-member] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_members [ 935.493966] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGHEST for action security_group_members [ 935.493966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.493966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.493966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.493966] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.496271] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.528710] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.530135] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.530135] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.530135] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.530135] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.530384] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.530384] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.530489] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.530638] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.530856] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.530972] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.531097] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.531207] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.531316] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.531421] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.531552] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.539481] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5342876d-7958-411b-8950-a1807733c36f [ 935.539675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.539789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.539854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.540079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.540163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.540251] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5342876d-7958-411b-8950-a1807733c36f already deleted. [ 935.540325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5342876d-7958-411b-8950-a1807733c36f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.554172] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.556106] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 935.556106] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.556106] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-228" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.556106] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-827e4877-5842-4962-b5de-38a08b1f1693 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.556451] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.556493] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.556838] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.556991] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('827e4877-5842-4962-b5de-38a08b1f1693',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.625505] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.782738] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 935.782952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.783171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.783390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.783576] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.783772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.783772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.783890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.783973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.784079] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.786024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: SUCCESS [ 935.786138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.786638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.786842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.787071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.787211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.787296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.787462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.787565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.787678] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.814955] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.815212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.815313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.815592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.815759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.816165] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.816324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.816423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.816630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.816851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.817108] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 is going to be updated. [ 935.839649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.839846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.846734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.848076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.848159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.848458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.849112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.857592] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: IN_PROGRESS for 2s [ 935.994730] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.995186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.995332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.995576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.995681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.996286] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.996286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.996286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.996286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.996449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.996478] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 is going to be updated. [ 935.998859] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.034910] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.035124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.035189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.035404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.035574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.045227] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: IN_PROGRESS for 2s [ 936.062161] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.062378] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.062518] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.062789] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.062983] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.063105] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 827e4877-5842-4962-b5de-38a08b1f1693 not found, creating... [ 936.063369] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.063575] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.063638] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.063876] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.064072] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.064674] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.064674] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.064674] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.064909] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.064909] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.065667] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 827e4877-5842-4962-b5de-38a08b1f1693 is going to be created. [ 936.085618] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.086355] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.086355] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.086355] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.086510] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.086747] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.129367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.129367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.129367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.129367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.129367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.129546] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 is going to be updated. [ 936.139959] env[69219]: INFO networking_nsxv3.common.synchronization [req-b00eca6d-bfd9-453f-a23b-de9bc1eb5189 req-ec5500fb-bcd9-41fe-8e88-f7167b2d0da7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_members [ 936.139959] env[69219]: INFO networking_nsxv3.common.synchronization [req-b00eca6d-bfd9-453f-a23b-de9bc1eb5189 req-ec5500fb-bcd9-41fe-8e88-f7167b2d0da7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 936.140128] env[69219]: INFO networking_nsxv3.common.synchronization [req-b00eca6d-bfd9-453f-a23b-de9bc1eb5189 req-ec5500fb-bcd9-41fe-8e88-f7167b2d0da7 tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 936.141527] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 with Priority: HIGHEST for action security_group_members [ 936.141527] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGHEST for action security_group_members [ 936.141527] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 936.141527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04f4d-823f-4a5c-800d-0d26247d20e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.141748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.141788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.142387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.142387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.142387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.167742] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 936.167955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.172560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.172686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.172751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.172955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.173128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.181721] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 in Status: IN_PROGRESS for 2s [ 936.289578] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.290492] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.507135] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.507135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.507135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.507135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.507135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.507135] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 936.531910] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.532235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.532235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.532633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.532797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.543076] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 936.792509] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.793619] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.860830] env[69219]: INFO networking_nsxv3.common.synchronization [req-0e0da3bb-8976-43ef-b572-389480ff6066 req-7d72998d-464b-4fa0-a1ca-bf8924238c36 service nova] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_rules [ 936.861117] env[69219]: INFO networking_nsxv3.common.synchronization [req-0e0da3bb-8976-43ef-b572-389480ff6066 req-7d72998d-464b-4fa0-a1ca-bf8924238c36 service nova] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 936.861448] env[69219]: INFO networking_nsxv3.common.synchronization [req-0e0da3bb-8976-43ef-b572-389480ff6066 req-7d72998d-464b-4fa0-a1ca-bf8924238c36 service nova] Enqueued Resource ID: 827e4877-5842-4962-b5de-38a08b1f1693 with Priority: HIGHEST for action port [ 936.862091] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_rules [ 936.862743] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 936.862876] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 827e4877-5842-4962-b5de-38a08b1f1693 with Priority: HIGHEST for action port [ 936.865362] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.865429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.865514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.865825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.865894] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.866971] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.867119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.867373] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-827e4877-5842-4962-b5de-38a08b1f1693 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.867498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.867581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.867804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.867906] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('827e4877-5842-4962-b5de-38a08b1f1693',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.296501] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.296501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.296501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.296501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.296501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.296501] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 937.298512] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.298875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.299180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.299562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.299810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.300109] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be updated. [ 937.329717] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.330034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.330159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.330608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.330663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.335743] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.335743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.335743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.335743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.336948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.348202] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 937.349120] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: IN_PROGRESS for 2s [ 937.370208] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.370575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.370818] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 827e4877-5842-4962-b5de-38a08b1f1693 with status ACTIVE [ 937.371123] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.371341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.371458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.371754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.371892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.372199] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.372344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.372541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.372682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.372803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.373097] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.373317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.373359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.373566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.373686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.373814] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 827e4877-5842-4962-b5de-38a08b1f1693 is going to be updated. [ 937.400228] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.400228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.400228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.400228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.400469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.401025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-827e4877-5842-4962-b5de-38a08b1f1693" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.721094] env[69219]: INFO networking_nsxv3.common.synchronization [None req-df952964-4b92-4550-bf93-2bd541870b21 None None] Enqueued Resource ID: d1030b91-17f6-41bf-a770-eb0e69c2f9b7 with Priority: HIGHEST for action port [ 937.721387] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1030b91-17f6-41bf-a770-eb0e69c2f9b7 with Priority: HIGHEST for action port [ 937.722359] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1030b91-17f6-41bf-a770-eb0e69c2f9b7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.722540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1030b91-17f6-41bf-a770-eb0e69c2f9b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.722570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1030b91-17f6-41bf-a770-eb0e69c2f9b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.722803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1030b91-17f6-41bf-a770-eb0e69c2f9b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.722884] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1030b91-17f6-41bf-a770-eb0e69c2f9b7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.869875] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc9fb959-a076-420f-a95e-66822d85fa97 in Status: SUCCESS [ 937.869875] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 deletion is rescheduled due to dependency. [ 937.869875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.056414] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 in Status: SUCCESS [ 938.056414] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 deletion is rescheduled due to dependency. [ 938.056414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.193503] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 in Status: SUCCESS [ 938.193503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.193619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.193863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.197065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.197065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.197065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.197065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.197065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.197065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.197065] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.197065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.197582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.197582] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.197923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.197923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.198434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.198434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.198539] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.226526] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1030b91-17f6-41bf-a770-eb0e69c2f9b7 [ 938.226844] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.226978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.226978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.227199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.227304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.227442] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1030b91-17f6-41bf-a770-eb0e69c2f9b7 already deleted. [ 938.227501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1030b91-17f6-41bf-a770-eb0e69c2f9b7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.556241] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 938.557098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.557098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.557098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.557098] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.557232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.557267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.557454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.557551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.557650] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.704363] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.704363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.704550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.704714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.704858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.705173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.705329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.705430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.705665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.705789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.705923] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 is going to be deleted. [ 938.707392] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dad04f4d-823f-4a5c-800d-0d26247d20e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.742853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.742853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.742853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.743182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.743337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.743480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.061903] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.210664] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dad04f4d-823f-4a5c-800d-0d26247d20e8: rpc.has_security_group_logging(os_id): False [ 939.229173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.229407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.229407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.229580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.229666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.229885] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.230035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.230111] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.230277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.230369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.230442] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 is going to be created. [ 939.251568] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/dad04f4d-823f-4a5c-800d-0d26247d20e8], does not exist path=[/infra/domains/default/groups/dad04f4d-823f-4a5c-800d-0d26247d20e8]."\n}' [ 939.251568] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dad04f4d-823f-4a5c-800d-0d26247d20e8 [ 939.251568] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 939.289299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.289508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.289508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.289709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.290896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.291242] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.291359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.291409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.291604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.291691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.292703] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.292703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.292703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.292703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.292703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.292703] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad04f4d-823f-4a5c-800d-0d26247d20e8 is going to be created. [ 939.310373] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/dad04f4d-823f-4a5c-800d-0d26247d20e8], does not exist path=[/infra/domains/default/groups/dad04f4d-823f-4a5c-800d-0d26247d20e8]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dad04f4d-823f-4a5c-800d-0d26247d20e8 [ 939.310373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad04f4d-823f-4a5c-800d-0d26247d20e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.310373] env[69219]: Traceback (most recent call last): [ 939.310373] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 939.310373] env[69219]: return func(*args, **kwargs) [ 939.310373] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 939.310373] env[69219]: res.raise_for_status() [ 939.310373] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 939.310373] env[69219]: raise HTTPError(http_error_msg, response=self) [ 939.310373] env[69219]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dad04f4d-823f-4a5c-800d-0d26247d20e8 [ 939.310373] env[69219]: During handling of the above exception, another exception occurred: [ 939.310373] env[69219]: Traceback (most recent call last): [ 939.310896] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 939.310896] env[69219]: listener.cb(fileno) [ 939.310896] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 939.310896] env[69219]: result = function(*args, **kwargs) [ 939.310896] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 939.310896] env[69219]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 939.310896] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 939.310896] env[69219]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 939.310896] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 939.310896] env[69219]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 939.310896] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 939.310896] env[69219]: res.raise_for_status() [ 939.310896] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 939.310896] env[69219]: raise HTTPError(http_error_msg, response=self) [ 939.310896] env[69219]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dad04f4d-823f-4a5c-800d-0d26247d20e8 [ 939.310896] env[69219]: Removing descriptor: 20 [ 939.359362] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 939.359526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.360259] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: SUCCESS [ 939.360421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.361028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.361028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.361028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.361176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.361207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.361560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.361632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.361817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.361899] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.362128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.362128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.362214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.362352] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.363295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.363295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.363295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.363295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.363295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.363295] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.364680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.364761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.364908] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.365046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.365087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.365225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.365303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.365391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.365485] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.367053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.367901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.367901] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.367901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.367901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.372089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.372336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.372455] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.373162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.373395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.374073] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.374073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.374073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.374073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.374073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.374073] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.442040] env[69219]: INFO networking_nsxv3.common.synchronization [req-63849d93-4a76-4b34-bb8e-9b53509bc350 req-2a0bb27f-60ab-4a65-8014-8494487ffe42 tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 939.442583] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 939.442891] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.443820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.443820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.443820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.443820] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.443820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.443820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.443820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.443820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.444135] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.564605] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.868362] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd: rpc.has_security_group_logging(os_id): False [ 939.876792] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.877684] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.878479] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.879449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.879449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.879449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.886980] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.887122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.894690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.894877] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.895765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.895765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.895765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.895765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.895765] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be updated. [ 939.896551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.896741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.924196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.924626] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.924626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.924726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.924928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.925029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.925180] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.925286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.925349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.925541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.925688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.925808] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.925901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.925964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.926204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.926307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.926439] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 939.933894] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.933989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.934085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.934251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.934378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.942229] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: IN_PROGRESS for 2s [ 939.945548] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.996223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.996309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.996394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.996605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.996754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.008121] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 940.068312] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.069596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.069596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.069596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.069596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.069596] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 940.093715] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.093922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.094037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.094303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.094479] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.115913] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 940.381952] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcba48ed-3f96-4cef-8edf-50ba05bacea8: rpc.has_security_group_logging(os_id): False [ 940.382965] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.399574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.399659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.399797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.400087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.400144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.400497] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.400497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.400814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.400814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.400814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.400905] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be updated. [ 940.449115] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.451187] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.451334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.451400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.452497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.452497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.468618] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: IN_PROGRESS for 2s [ 940.885865] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.886123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.886207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.886430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.886550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.886660] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 940.913135] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.913323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.913365] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.913610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.914626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.933244] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 940.953933] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.954164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.954164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.954379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.954551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.954681] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 940.979300] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.979463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.979524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.979719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.979863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.990686] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 941.952097] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: SUCCESS [ 941.952413] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 deletion is rescheduled due to dependency. [ 941.952413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.021066] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 942.021181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.021300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.021514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.021638] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.125439] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 942.125676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.125851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.126102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.126299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.126515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.126515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.126633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.126742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.126904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.126904] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.311359] env[69219]: INFO networking_nsxv3.common.synchronization [req-86748d76-dcee-48b8-a811-4cdbb7964091 req-92fc3010-84f1-46d9-be52-72308be4c43a tempest-ServerRescueTestJSON-570394754 tempest-ServerRescueTestJSON-570394754-project-member] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 942.311939] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 942.312214] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.312339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.312398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.312598] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.312745] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.312840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.312892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.313054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.313141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.313234] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.482367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 in Status: SUCCESS [ 942.482644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.523736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.523876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.623056] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.623382] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.624019] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.624264] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.624716] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.624995] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.625676] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.625676] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.625840] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.626205] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.626425] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.626641] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.627093] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.627093] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.627281] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.627518] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.629735] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.629912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.630116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.630706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.630706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.630845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.630845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.631888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.631888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.631888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.631888] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.631888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.631888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.632243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.632412] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.632496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.632610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.632835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.632968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.633147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.633306] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.655172] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.655352] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.655499] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.655712] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-196" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.656042] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.656227] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.656354] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.656680] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.656826] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf81f4a4-c134-46b7-90ac-ceea2ef78d5d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.819283] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.943958] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 942.943958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.944114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.944384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.944585] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.944704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.945143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.945345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.945427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.945514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.945644] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.000538] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 943.000799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.136442] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba38a24c-584a-4fc2-8fc4-91929e372e75: rpc.has_security_group_logging(os_id): False [ 943.153438] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.153582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.153671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.153859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.159621] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.159855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.160172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.160319] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.160531] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.160713] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port cf81f4a4-c134-46b7-90ac-ceea2ef78d5d not found, creating... [ 943.161037] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.161319] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.161422] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.161668] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.161813] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.162135] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.162308] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.162429] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.162686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.162823] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.163025] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: cf81f4a4-c134-46b7-90ac-ceea2ef78d5d is going to be created. [ 943.171485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.171650] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.171774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.171836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.172068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.172142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.172376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.172497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.172589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.172753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.172832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.173054] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.173154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.173212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.173352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.173440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.173548] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 943.180365] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.180597] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.180683] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.181533] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.181835] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.181999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.250763] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.250887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.250982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.251193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.251342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.267086] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 943.321619] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.450148] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.450148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.450148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.450363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.450614] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.450614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.450614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.450859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.450859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.450944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.451185] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.451296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.451398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.451554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.451717] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.451837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.451886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.452021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.452101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.452223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.452285] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.824768] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.824993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.825206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.825514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.825568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.825757] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be updated. [ 943.852422] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.852699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.852699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.853231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.853231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.863977] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: IN_PROGRESS for 2s [ 943.914976] env[69219]: INFO networking_nsxv3.common.synchronization [req-86748d76-dcee-48b8-a811-4cdbb7964091 req-9acddcbc-f0bf-47e7-bbf8-295948b54c47 service nova] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_rules [ 943.914976] env[69219]: INFO networking_nsxv3.common.synchronization [req-86748d76-dcee-48b8-a811-4cdbb7964091 req-9acddcbc-f0bf-47e7-bbf8-295948b54c47 service nova] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 943.914976] env[69219]: INFO networking_nsxv3.common.synchronization [req-86748d76-dcee-48b8-a811-4cdbb7964091 req-9acddcbc-f0bf-47e7-bbf8-295948b54c47 service nova] Enqueued Resource ID: cf81f4a4-c134-46b7-90ac-ceea2ef78d5d with Priority: HIGHEST for action port [ 943.914976] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_rules [ 943.914976] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 943.914976] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf81f4a4-c134-46b7-90ac-ceea2ef78d5d with Priority: HIGHEST for action port [ 943.914976] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.915527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.915527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.915527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.915527] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.916837] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.917013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.917326] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.917445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.917510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.917730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.917809] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf81f4a4-c134-46b7-90ac-ceea2ef78d5d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.954684] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd: rpc.has_security_group_logging(os_id): False [ 943.974027] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.974270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.974392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.974716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.974850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.975193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.975397] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.975531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.975751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.975841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.976058] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.976161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.976258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.976450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.976573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.976839] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.976948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.977034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.977170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.977266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.977354] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 944.034187] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.034526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.034526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.034600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.034757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.049245] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 944.422539] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.422940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.423218] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf81f4a4-c134-46b7-90ac-ceea2ef78d5d with status ACTIVE [ 944.423398] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.423519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.423590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.423821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.423905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.424083] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.424183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.424241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.424388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.424463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.424691] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.424738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.424805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.424913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.425018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.425068] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf81f4a4-c134-46b7-90ac-ceea2ef78d5d is going to be updated. [ 944.445071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.445191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.445269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.445590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.445660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.445860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf81f4a4-c134-46b7-90ac-ceea2ef78d5d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.075965] env[69219]: INFO networking_nsxv3.common.synchronization [req-772d76a0-466e-4f3e-b53d-faa9dce2e446 req-50d73740-be1e-41c5-9fbd-a199357c589f tempest-ServersWithSpecificFlavorTestJSON-1490539426 tempest-ServersWithSpecificFlavorTestJSON-1490539426-project-member] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 945.076690] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 945.077837] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.077837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.077837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.078142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.078304] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.078412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.078501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.079452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.079452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.079452] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.280808] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 945.281077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.544443] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.544656] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.544788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.545081] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.545350] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.545511] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.545633] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.545855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.546015] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.547326] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.547326] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.547326] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.547498] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.547595] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.547739] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.547932] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.566175] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.566389] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.566536] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.567325] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-609" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.567923] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.568392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.568392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.568628] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.568831] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('623c816c-3bd1-42e8-9a0f-3cf02f0fa69a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.584067] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.584067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.584067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.584067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.606229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.607585] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.607585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.607585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.607585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.607585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.607585] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 is going to be updated. [ 945.635238] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.635238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.635238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.635238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.635238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.641871] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: IN_PROGRESS for 2s [ 945.694024] env[69219]: INFO networking_nsxv3.common.synchronization [req-7272b65b-a98c-4ca2-870c-95e8969092e4 req-5d328e36-b221-48af-9f13-bdec87268ae8 tempest-ServersTestFqdnHostnames-37187543 tempest-ServersTestFqdnHostnames-37187543-project-member] Enqueued Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_members [ 945.694024] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGHEST for action security_group_members [ 945.694024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.694376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.694532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.694827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.695110] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.695346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.695514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.695758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.695935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.696166] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.877599] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: SUCCESS [ 945.878112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.878419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.878888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.879211] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.879468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.879702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.879982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.882017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.882017] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.071517] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 946.071517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.076224] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.076224] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.076224] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.076224] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.076224] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.076699] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 623c816c-3bd1-42e8-9a0f-3cf02f0fa69a not found, creating... [ 946.076699] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.076790] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.076904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.077152] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.077295] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.077788] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.077788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.077933] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.078230] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.078384] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.078530] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 623c816c-3bd1-42e8-9a0f-3cf02f0fa69a is going to be created. [ 946.100282] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.100459] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.100592] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.100871] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.101124] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.101368] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.198718] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.198873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.198948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.199209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.231987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.232226] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.232226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.232349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.232764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.232764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.232764] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d is going to be updated. [ 946.262036] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.262208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.262250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.262465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.262686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.271906] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d in Status: IN_PROGRESS for 2s [ 946.383635] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.887825] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.905317] env[69219]: INFO networking_nsxv3.common.synchronization [req-772d76a0-466e-4f3e-b53d-faa9dce2e446 req-bb664e00-717f-4e5e-9808-bc84a5c19849 service nova] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 946.905578] env[69219]: INFO networking_nsxv3.common.synchronization [req-772d76a0-466e-4f3e-b53d-faa9dce2e446 req-bb664e00-717f-4e5e-9808-bc84a5c19849 service nova] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 946.905809] env[69219]: INFO networking_nsxv3.common.synchronization [req-772d76a0-466e-4f3e-b53d-faa9dce2e446 req-bb664e00-717f-4e5e-9808-bc84a5c19849 service nova] Enqueued Resource ID: 623c816c-3bd1-42e8-9a0f-3cf02f0fa69a with Priority: HIGHEST for action port [ 946.906633] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_rules [ 946.906845] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 946.906969] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 623c816c-3bd1-42e8-9a0f-3cf02f0fa69a with Priority: HIGHEST for action port [ 946.907410] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.907581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.907674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.908017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.908154] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.909359] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.909494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.909817] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.909965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.910082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.910319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.910451] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('623c816c-3bd1-42e8-9a0f-3cf02f0fa69a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.390555] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.391613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.391613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.391613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.391789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.391826] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be updated. [ 947.412872] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.413048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.414330] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 623c816c-3bd1-42e8-9a0f-3cf02f0fa69a with status ACTIVE [ 947.414508] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.414624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.414688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.414914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.415011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.415221] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.415340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.415389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.415555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.415673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.415811] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.415921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.415994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.416177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.416262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.416347] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 623c816c-3bd1-42e8-9a0f-3cf02f0fa69a is going to be updated. [ 947.419353] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.419470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.419523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.419674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.419805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.428443] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: IN_PROGRESS for 2s [ 947.434986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.435139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.435220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.435378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.435510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.435666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-623c816c-3bd1-42e8-9a0f-3cf02f0fa69a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.653309] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: SUCCESS [ 947.653461] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 deletion is rescheduled due to dependency. [ 947.653585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.654673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.654673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.654673] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.654673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.654673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.654673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.654673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.654992] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.156963] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.282933] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d in Status: SUCCESS [ 948.282933] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d deletion is rescheduled due to dependency. [ 948.283053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.661410] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.165602] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.165833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.165953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.166630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.166630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.166630] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 is going to be updated. [ 949.193264] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.193416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.193488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.193702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.193852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.203972] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: IN_PROGRESS for 2s [ 949.444329] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: SUCCESS [ 949.444705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.447153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.447404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.447612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.447751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.447836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.448012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.448116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.448216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.448311] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.862898] env[69219]: INFO networking_nsxv3.common.synchronization [req-f71ec082-b7f4-492f-9007-64ec09168f6b req-5ef9a62c-9cac-435f-b58d-e2cc908bfb6b tempest-ListImageFiltersTestJSON-2006389702 tempest-ListImageFiltersTestJSON-2006389702-project-member] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 949.863654] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGHEST for action security_group_members [ 949.863967] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.867917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.867917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.867917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.867917] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.867917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.867917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.867917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.868483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.868655] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.950416] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.950563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.950660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.950897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.951112] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.951285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.951332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.951558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.951684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.952270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.952270] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.952270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.952270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.952270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.952555] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.952612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.952780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.952863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.952990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.953144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.953352] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.374612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.374815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.374889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.375130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.395371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.395680] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.395820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.395885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.396140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.396228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.396336] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be updated. [ 950.419986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.420241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.420351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.420515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.420659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.431757] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: IN_PROGRESS for 2s [ 950.456283] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c06b0f72-9b10-4089-a399-981c25e289e8: rpc.has_security_group_logging(os_id): False [ 950.473537] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.473689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.473777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.473984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.492735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.493091] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.493230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.493298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.493507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.493595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.493799] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.493905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.493951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.494115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.494691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.494691] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.494691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.494691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.494691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.494691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.494930] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be updated. [ 950.547966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.549858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.549858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.549858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.549858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.562743] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: IN_PROGRESS for 2s [ 951.213389] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: SUCCESS [ 951.213706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.213763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.213979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.214188] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.214310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.214425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.214577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.214664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.214751] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.214842] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.716790] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.095715] env[69219]: INFO networking_nsxv3.common.synchronization [req-aa1a43ad-3eda-4c6b-a72d-5ab8ec93a4a0 req-736d63c3-b55e-4355-a138-0fc7f3f29c57 tempest-ServerAddressesTestJSON-1403486280 tempest-ServerAddressesTestJSON-1403486280-project-member] Enqueued Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_members [ 952.095715] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_members [ 952.096028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.096087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.096116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.096374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.096529] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.096622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.096690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.096843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.096930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.097048] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.219214] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd4746a8-624d-411a-b8a7-b5c965021a51: rpc.has_security_group_logging(os_id): False [ 952.247900] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.248163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.248235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.248591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.248736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.249146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.249392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.249392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.249600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.249702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.249795] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 is going to be updated. [ 952.314285] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.315340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.315340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.315340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.315340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.328915] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: IN_PROGRESS for 2s [ 952.443261] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c in Status: SUCCESS [ 952.443444] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c deletion is rescheduled due to dependency. [ 952.443541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.576806] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: SUCCESS [ 952.577099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.599123] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.599945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.599945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.599945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.599945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.599945] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.599945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.600252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.600252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.600332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.600418] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 already deleted. [ 952.600496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.956753] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.957175] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-307" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.957429] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-307" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.957846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-307" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.958811] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.959161] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.959414] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.959784] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.960122] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.961116] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.961116] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.961116] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.961116] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.961116] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.961116] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.961679] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.980245] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.980245] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.980245] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.980368] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-307" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.980617] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-a673c5b4-25ca-488e-b274-01ec2e383b8b taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.980789] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.980910] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.981260] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.984022] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a673c5b4-25ca-488e-b274-01ec2e383b8b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.485949] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.486284] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.486400] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.486675] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.486792] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.486951] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port a673c5b4-25ca-488e-b274-01ec2e383b8b not found, creating... [ 953.487400] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.487400] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.487526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.489172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.489172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.489172] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.489172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.489172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.489172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.489172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.489172] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: a673c5b4-25ca-488e-b274-01ec2e383b8b is going to be created. [ 953.512976] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.513324] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.513500] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.513831] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.514147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.514443] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.326729] env[69219]: INFO networking_nsxv3.common.synchronization [req-aa1a43ad-3eda-4c6b-a72d-5ab8ec93a4a0 req-0f9e46b0-09d0-4d4a-ac70-528f68c21ae0 service nova] Enqueued Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_rules [ 954.326905] env[69219]: INFO networking_nsxv3.common.synchronization [req-aa1a43ad-3eda-4c6b-a72d-5ab8ec93a4a0 req-0f9e46b0-09d0-4d4a-ac70-528f68c21ae0 service nova] Enqueued Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_members [ 954.327067] env[69219]: INFO networking_nsxv3.common.synchronization [req-aa1a43ad-3eda-4c6b-a72d-5ab8ec93a4a0 req-0f9e46b0-09d0-4d4a-ac70-528f68c21ae0 service nova] Enqueued Resource ID: a673c5b4-25ca-488e-b274-01ec2e383b8b with Priority: HIGHEST for action port [ 954.327762] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_rules [ 954.327762] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_members [ 954.327762] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a673c5b4-25ca-488e-b274-01ec2e383b8b with Priority: HIGHEST for action port [ 954.329711] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.329711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.329878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.330848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.330848] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.331166] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.331794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.332047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.332089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.332952] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.332952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.332952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.332952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.332952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.332952] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.335651] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-a673c5b4-25ca-488e-b274-01ec2e383b8b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.335651] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.335651] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.335651] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.335651] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a673c5b4-25ca-488e-b274-01ec2e383b8b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.351441] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: SUCCESS [ 954.351744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.582415] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f9097a62-cf07-4689-81b0-de77c7765d22 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 3d16626e-e369-4964-a0e2-8b43b64f11df with Priority: HIGHEST for action security_group_rules [ 954.582760] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d16626e-e369-4964-a0e2-8b43b64f11df with Priority: HIGHEST for action security_group_rules [ 954.583035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d16626e-e369-4964-a0e2-8b43b64f11df taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.583307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.583307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.583498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.583569] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d16626e-e369-4964-a0e2-8b43b64f11df',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.712998] env[69219]: INFO networking_nsxv3.common.synchronization [None req-797255f9-8124-4a78-93df-0b113bf37f8d tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 3d16626e-e369-4964-a0e2-8b43b64f11df with Priority: HIGHEST for action security_group_rules [ 954.713554] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d16626e-e369-4964-a0e2-8b43b64f11df with Priority: HIGHEST for action security_group_rules [ 954.713859] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d16626e-e369-4964-a0e2-8b43b64f11df taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.713962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.836239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.836394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.837797] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.838751] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a673c5b4-25ca-488e-b274-01ec2e383b8b with status ACTIVE [ 954.839010] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.839197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.839237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.839437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.839566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.839732] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.839830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.839891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.840066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.840121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.840299] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.840410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.840467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.840600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.840670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.841009] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a673c5b4-25ca-488e-b274-01ec2e383b8b is going to be updated. [ 954.863554] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.863554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.863554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.863554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.863836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.863836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a673c5b4-25ca-488e-b274-01ec2e383b8b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.117659] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.117777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.117879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.118290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.118390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.118495] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d16626e-e369-4964-a0e2-8b43b64f11df already deleted. [ 955.118584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.118738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.118901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.118986] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d16626e-e369-4964-a0e2-8b43b64f11df',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.345101] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.639507] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.639839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.639839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.639918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.640055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.640141] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d16626e-e369-4964-a0e2-8b43b64f11df already deleted. [ 955.640305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d16626e-e369-4964-a0e2-8b43b64f11df" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.854500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.854660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.854730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.854950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.855050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.855147] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 is going to be created. [ 955.880078] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.880078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.880078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.880488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.880488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.890421] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 in Status: UNINITIALIZED for 2s [ 957.902430] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 in Status: SUCCESS [ 957.902789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.903136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.903514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.903667] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.903849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.903953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.904238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.904493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.904573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.904674] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.270496] env[69219]: INFO networking_nsxv3.common.synchronization [req-95be287f-73dc-4737-9672-7681da822b7e req-f31ac1d1-d28e-4195-8411-0676f048e12d tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 958.271094] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 958.271530] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.271778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.271954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.272243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.272494] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.272713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.272855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.273115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.273298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.273469] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.411108] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.411271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.411334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.411544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.411736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.411838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.411903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.412069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.412614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.412614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.412614] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.412614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.412614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.412789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.412819] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.412895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.412962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.413124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.413188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.413260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.413380] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.775572] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.775761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.775798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.776011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.798407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.798792] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.798968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.799066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.799324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.799451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.799608] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 958.827905] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.828332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.828332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.828332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.828507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.836272] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 958.916050] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2: rpc.has_security_group_logging(os_id): False [ 958.933764] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.933948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.933999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.934269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.934402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.934648] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.934753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.934899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.935223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.935223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.935508] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.935613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.935684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.935844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.935913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.936115] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.936212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.936274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.936437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.936564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.936704] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 is going to be created. [ 958.989788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.989998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.989998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.990329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.990509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.000280] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 in Status: IN_PROGRESS for 2s [ 960.850769] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 960.851167] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 960.851167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.011545] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 in Status: SUCCESS [ 961.011894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.596075] env[69219]: INFO networking_nsxv3.common.synchronization [req-41455f67-d465-4f5a-b0c4-053b2cc6c27f req-0149c2b5-bf65-458e-94d3-e5f12ceda558 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 962.596647] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 962.596969] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.597104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.597212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.597435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.597591] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.597694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.597755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.597909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.597995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.598101] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.903143] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.903383] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.903502] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.903801] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.904082] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.904248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.904372] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.904592] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.904740] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.904951] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.905116] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.905238] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.905351] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.905464] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 962.905814] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.905814] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.924188] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.924397] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 962.924549] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.924733] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.925065] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.925380] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.925467] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.925778] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.925934] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d70b9c2-4794-4ffa-bc32-e1cc422e570a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.102216] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.104183] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.104183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.104183] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f already deleted. [ 963.104561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.273393] env[69219]: INFO networking_nsxv3.common.synchronization [req-31acbb36-9bc2-4d70-8016-c20847f36a27 req-45f2e2a5-cb5b-4893-9c31-4dac6f06bff6 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 963.273905] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 963.275822] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.275822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.275822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.275822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.275822] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.275822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.275822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.276552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.276552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.276552] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.428145] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.428145] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.428328] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.428855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.429055] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.429224] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 7d70b9c2-4794-4ffa-bc32-e1cc422e570a not found, creating... [ 963.429507] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.429674] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.429793] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.430037] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.430204] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.430496] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.430654] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.430777] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.430988] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.431199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.431341] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 7d70b9c2-4794-4ffa-bc32-e1cc422e570a is going to be created. [ 963.449718] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.449948] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.450139] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.450408] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.450644] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.450873] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.593261] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.593484] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.593620] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.593892] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.594177] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.594352] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.594539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.594823] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.595055] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.595325] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.595472] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.595585] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.595702] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.595819] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.595930] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.596086] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.614557] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.614734] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.615489] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.615489] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.615489] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-7cccf464-c504-4e90-a48f-0ec520109a2c taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.615670] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.615703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.616113] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.616347] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cccf464-c504-4e90-a48f-0ec520109a2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.778565] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.778565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.778716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.778856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.798867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.799174] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.799303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.799372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.799570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.799652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.799738] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 963.823237] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.823402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.823440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.823649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.823782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.834588] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 964.121606] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.121854] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.122047] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.122347] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.122510] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.122678] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 7cccf464-c504-4e90-a48f-0ec520109a2c not found, creating... [ 964.122969] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.123161] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.123291] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.123562] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.123754] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.124084] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.124266] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.124394] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.124675] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.124839] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.124988] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 7cccf464-c504-4e90-a48f-0ec520109a2c is going to be created. [ 964.143295] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.143527] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.143659] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.143957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.144206] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.144445] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.161548] env[69219]: INFO networking_nsxv3.common.synchronization [req-41455f67-d465-4f5a-b0c4-053b2cc6c27f req-9cadc2bd-76b4-4e73-8013-7bbe1aadf660 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 964.161683] env[69219]: INFO networking_nsxv3.common.synchronization [req-41455f67-d465-4f5a-b0c4-053b2cc6c27f req-9cadc2bd-76b4-4e73-8013-7bbe1aadf660 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 964.161853] env[69219]: INFO networking_nsxv3.common.synchronization [req-41455f67-d465-4f5a-b0c4-053b2cc6c27f req-9cadc2bd-76b4-4e73-8013-7bbe1aadf660 service nova] Enqueued Resource ID: 7d70b9c2-4794-4ffa-bc32-e1cc422e570a with Priority: HIGHEST for action port [ 964.165310] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 964.165310] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 964.165310] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d70b9c2-4794-4ffa-bc32-e1cc422e570a with Priority: HIGHEST for action port [ 964.165310] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.165310] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.165310] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.165310] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.165310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.166230] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.166230] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.166508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.166508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.166610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.166610] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d70b9c2-4794-4ffa-bc32-e1cc422e570a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.668458] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.668788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.672149] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d70b9c2-4794-4ffa-bc32-e1cc422e570a with status ACTIVE [ 964.672437] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.672628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.672763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.673888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.673888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.673888] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.673888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.673888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.673888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.673888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.674293] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.674293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.674415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.674569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.674648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.674701] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d70b9c2-4794-4ffa-bc32-e1cc422e570a is going to be updated. [ 964.677947] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.699196] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.699460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.699541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.699830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.700050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.700313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d70b9c2-4794-4ffa-bc32-e1cc422e570a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.079931] env[69219]: INFO networking_nsxv3.common.synchronization [req-31acbb36-9bc2-4d70-8016-c20847f36a27 req-90aaceb3-779b-46b8-8a2b-0d852dcb72c3 service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 965.080180] env[69219]: INFO networking_nsxv3.common.synchronization [req-31acbb36-9bc2-4d70-8016-c20847f36a27 req-90aaceb3-779b-46b8-8a2b-0d852dcb72c3 service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 965.080351] env[69219]: INFO networking_nsxv3.common.synchronization [req-31acbb36-9bc2-4d70-8016-c20847f36a27 req-90aaceb3-779b-46b8-8a2b-0d852dcb72c3 service nova] Enqueued Resource ID: 7cccf464-c504-4e90-a48f-0ec520109a2c with Priority: HIGHEST for action port [ 965.080846] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 965.080978] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 965.081534] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cccf464-c504-4e90-a48f-0ec520109a2c with Priority: HIGHEST for action port [ 965.081834] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.081954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.082042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.082837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.082926] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.083770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.083895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.084110] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cccf464-c504-4e90-a48f-0ec520109a2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.084219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.084284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.084512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.084613] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cccf464-c504-4e90-a48f-0ec520109a2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.180526] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.355910] env[69219]: INFO networking_nsxv3.common.synchronization [req-c9ae88ea-0070-43cd-b008-f1c870f9e6a8 req-6d7188d6-b373-4e08-a6fd-e17bda2057c2 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 965.356426] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 965.358921] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.359053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.359169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.359993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.360215] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.360321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.360388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.360557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.360647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.360744] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.588063] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cccf464-c504-4e90-a48f-0ec520109a2c with status ACTIVE [ 965.588446] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.589175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.589175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.589175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.589175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.589373] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.589438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.589489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.589613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.589687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.590438] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.590438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.590438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.590438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.590438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.590438] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cccf464-c504-4e90-a48f-0ec520109a2c is going to be updated. [ 965.592125] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.592246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.619750] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.619750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.619750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.619965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.620959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.620959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cccf464-c504-4e90-a48f-0ec520109a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.685749] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.686432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.688971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.688971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.688971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.688971] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be created. [ 965.715533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.717845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.717845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.717845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.717845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.729978] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: UNINITIALIZED for 2s [ 965.751169] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-70 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.751283] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.751391] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.751620] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.751889] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.752902] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.753101] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.753367] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.753603] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.753747] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.753865] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.753984] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.754120] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.754240] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.754347] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.754583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.774202] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.774440] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 965.774620] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.774818] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.775236] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-675c842d-98cb-4a69-9136-0792fb9822fa taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.775459] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.775624] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.775957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.776245] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('675c842d-98cb-4a69-9136-0792fb9822fa',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.843797] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 965.844037] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 deletion is rescheduled due to dependency. [ 965.844207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.844411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.844721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.844965] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.845332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.845332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.845481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.845580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.845768] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.862855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.863456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.863632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.864016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.882939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.883358] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.883491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.883567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.883754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.883838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.883928] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 965.912537] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.912693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.913556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.913919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.914104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.922516] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 966.281023] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.281023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 675c842d-98cb-4a69-9136-0792fb9822fa not found, creating... [ 966.281023] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.281023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.281592] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.281592] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.281592] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.281805] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.281866] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.282336] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 675c842d-98cb-4a69-9136-0792fb9822fa is going to be created. [ 966.299857] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.300081] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.300243] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.300532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.300755] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.301071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.348596] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.852306] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.044167] env[69219]: INFO networking_nsxv3.common.synchronization [req-c9ae88ea-0070-43cd-b008-f1c870f9e6a8 req-867adaf5-43f1-427e-aa57-ac63648e709a service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 967.044360] env[69219]: INFO networking_nsxv3.common.synchronization [req-c9ae88ea-0070-43cd-b008-f1c870f9e6a8 req-867adaf5-43f1-427e-aa57-ac63648e709a service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 967.044536] env[69219]: INFO networking_nsxv3.common.synchronization [req-c9ae88ea-0070-43cd-b008-f1c870f9e6a8 req-867adaf5-43f1-427e-aa57-ac63648e709a service nova] Enqueued Resource ID: 675c842d-98cb-4a69-9136-0792fb9822fa with Priority: HIGHEST for action port [ 967.045096] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 967.045250] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 967.045366] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 675c842d-98cb-4a69-9136-0792fb9822fa with Priority: HIGHEST for action port [ 967.045657] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.045780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.045844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.046056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.046141] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.047287] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.047395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.047583] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-675c842d-98cb-4a69-9136-0792fb9822fa taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.047680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.047737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.047909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.047977] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('675c842d-98cb-4a69-9136-0792fb9822fa',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.355528] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.355747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.355939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.356192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.356331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.356474] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 967.389039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.389226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.389358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.389516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.389663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.398390] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 967.550400] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.550540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.550770] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 675c842d-98cb-4a69-9136-0792fb9822fa with status ACTIVE [ 967.550949] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.551126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.551126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.552080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.552080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.552080] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.552080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.552080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.552080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.552330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.552330] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.552415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.552415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.552575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.552619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.552941] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 675c842d-98cb-4a69-9136-0792fb9822fa is going to be updated. [ 967.576168] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.576353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.576391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.576598] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.576735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.576899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-675c842d-98cb-4a69-9136-0792fb9822fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.740597] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.740597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.740597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.740597] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.841512] env[69219]: INFO networking_nsxv3.common.synchronization [req-8194dd9f-62cd-47c2-b774-668bf73c399f req-f0466ee4-d814-482c-84b9-38fc1f33c886 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 967.842070] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 967.842834] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.842975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.847077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.847335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.847558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.849402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.849553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.849774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.849894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.850262] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.932956] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 967.933347] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 967.933347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.933892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.934114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.934302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.934421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.934486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.934642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.934723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.934819] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.244247] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.244247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.244247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.244247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.244247] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.244247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.244247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.244735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.244735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.244735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.244735] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.244735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.244996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.244996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.245126] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.245236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.245293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.245434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.245507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.245588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.245674] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.320828] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.321338] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.321338] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.321600] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.321834] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.322040] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.322163] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.322396] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.322559] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.322944] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.323090] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.323204] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.323318] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.323442] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 968.323553] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.323693] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.343843] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.343843] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 968.343843] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.343843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.344048] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-4f088987-e289-4308-bfe1-cb590146da4e taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.344228] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.344388] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.345023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.345023] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f088987-e289-4308-bfe1-cb590146da4e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.353587] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.353745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.353815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.354050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.354144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.354344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.354448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.354509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.354666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.354755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.354823] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 already deleted. [ 968.354901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.437255] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.751482] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605a443b-d883-4950-9fad-dd508996ac8f: rpc.has_security_group_logging(os_id): False [ 968.768773] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.769117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.769117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.769338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.769462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.769707] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.769874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.769909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.770083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.770391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.770460] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.770556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.770620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.770764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.770856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.771090] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.771319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.771378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.771549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.771654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.771761] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be created. [ 968.849059] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.849734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.849734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.849734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.849926] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.850338] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 4f088987-e289-4308-bfe1-cb590146da4e not found, creating... [ 968.850455] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.850718] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.850817] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.851092] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.851433] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.851612] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.851779] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.851899] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.853446] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.853619] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.853815] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 4f088987-e289-4308-bfe1-cb590146da4e is going to be created. [ 968.884910] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.884910] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.884910] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.884910] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.884910] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.885468] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.894361] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.894739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.894830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.895205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.895294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.905114] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 968.940651] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.408460] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 969.408533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.408865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.408865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.409303] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.409430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.409527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.409701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.409786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.409874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.409967] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.444281] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.444281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.444436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.444714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.444817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.444980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 969.472683] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.473018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.473134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.473399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.473578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.481911] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 969.575200] env[69219]: INFO networking_nsxv3.common.synchronization [req-8194dd9f-62cd-47c2-b774-668bf73c399f req-da10c2f6-a963-4805-83f0-6d269654f7cc service nova] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_rules [ 969.575627] env[69219]: INFO networking_nsxv3.common.synchronization [req-8194dd9f-62cd-47c2-b774-668bf73c399f req-da10c2f6-a963-4805-83f0-6d269654f7cc service nova] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 969.575968] env[69219]: INFO networking_nsxv3.common.synchronization [req-8194dd9f-62cd-47c2-b774-668bf73c399f req-da10c2f6-a963-4805-83f0-6d269654f7cc service nova] Enqueued Resource ID: 4f088987-e289-4308-bfe1-cb590146da4e with Priority: HIGHEST for action port [ 969.576770] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_rules [ 969.577077] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 969.577358] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f088987-e289-4308-bfe1-cb590146da4e with Priority: HIGHEST for action port [ 969.577904] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.578197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.578863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.578863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.578999] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.580420] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.580595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.580732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.581012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.582660] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.582660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.582660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.582660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.582660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.582660] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.582912] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f088987-e289-4308-bfe1-cb590146da4e taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.582992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.585189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.585392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.585469] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f088987-e289-4308-bfe1-cb590146da4e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.912195] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.912395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.912532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.913173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.913173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.913173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.913173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.913429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.913429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.913429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.914519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.914519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.914519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.914519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.914519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.914519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.914519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.914805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.914805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.914805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.914883] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.088281] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.088682] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.088799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.089061] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f088987-e289-4308-bfe1-cb590146da4e with status ACTIVE [ 970.089548] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.089548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.089548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.090352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.090352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.090352] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.090352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.090352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.090635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.090635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.090722] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.090864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.090920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.091134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.091236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.091322] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f088987-e289-4308-bfe1-cb590146da4e is going to be updated. [ 970.111831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.111831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.111831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.111831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.111831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.111831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f088987-e289-4308-bfe1-cb590146da4e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.417427] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0687614d-5fbe-486f-942e-47e8dcdc82e2: rpc.has_security_group_logging(os_id): False [ 970.435195] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.435339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.435339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.435578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.435667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.436383] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.436383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.436383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.436383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.436383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.436622] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.436622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.436622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.437341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.437341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.437341] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.437341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.437341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.437341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.437341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.437587] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 970.498102] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.498923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.498923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.498923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.498923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.510057] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 970.593653] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.865162] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2cf49f19-7e3f-48fa-97bd-3e4301002b24 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 970.865162] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 970.867412] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.867626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.867700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.867937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.868182] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.868293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.868378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.868603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.868711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.868809] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.924434] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 970.925044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.098222] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.098222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.098222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.098222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.098222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.098222] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be created. [ 971.127021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.127021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.127021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.127021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.127021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.140240] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: UNINITIALIZED for 2s [ 971.371688] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.491590] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 971.491809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.491974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.492227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.492796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.492796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.492796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.492796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.493034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.493034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.493034] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.671094] env[69219]: INFO networking_nsxv3.common.synchronization [req-aab77651-7944-4cc4-a758-9c3298d40781 req-682ec43a-1f4a-4804-91a4-786d3002a25c tempest-ServerAddressesTestJSON-1403486280 tempest-ServerAddressesTestJSON-1403486280-project-member] Enqueued Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_members [ 971.671632] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGHEST for action security_group_members [ 971.671949] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.672500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.674777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.674777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.674777] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.674777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.674777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.674777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.674777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.674777] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.789082] env[69219]: INFO networking_nsxv3.common.synchronization [req-462fb77d-c75b-47a7-ae23-8e0cca9ce9e1 req-46d0510b-7dbd-4f69-a91d-3c13e93b17ca tempest-ServerRescueTestJSON-570394754 tempest-ServerRescueTestJSON-570394754-project-member] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 971.789605] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 971.789923] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.790052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.790117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.790344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.790498] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.790584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.790645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.790790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.790870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.790955] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.875052] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.995711] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.995964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.995964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.996198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.996406] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.996680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.996680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.996859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.996992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.997159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.997370] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.997508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.997600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.997795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.997998] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.998124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.998189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.998336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.998416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.998520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.998647] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.177382] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.178794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.178794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.178794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.178959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.179302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.179564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.179622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.179840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.179955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.180905] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 is going to be updated. [ 972.207943] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.208312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.208312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.208547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.208733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.216834] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 in Status: IN_PROGRESS for 2s [ 972.294200] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.377367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.377602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.377718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.378012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.378178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.378301] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 972.414160] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.414345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.414444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.414685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.414842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.436722] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 972.502170] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 972.523522] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.523917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.524076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.524640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.524830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.525169] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.525314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.525397] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.525692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.526098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.526236] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.526436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.526514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.527148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.529076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.529076] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.529076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.529076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.529076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.529076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.529076] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 972.533279] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 972.533589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.613605] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.613854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.613854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.614056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.614237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.628941] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 972.796721] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.150503] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: SUCCESS [ 973.150732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.150912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.151141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.151361] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.151718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.151718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.151718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.151836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.151867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.151976] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.299671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.299999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.299999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.300223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.300322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.300454] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be updated. [ 973.320426] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.320733] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.320733] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.321099] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.324568] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.324787] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.324936] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.325363] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.325567] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.325808] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.326388] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.326388] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.326388] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.326388] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.326388] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.326715] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.334118] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.334118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.334118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.334118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.334118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.342230] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: IN_PROGRESS for 2s [ 973.344871] env[69219]: INFO networking_nsxv3.common.synchronization [req-df74f2cc-335c-482a-b37b-6b6754cfd206 req-f88ab299-5687-4486-9ea9-9a8ae593d4eb tempest-ServersNegativeTestJSON-974271614 tempest-ServersNegativeTestJSON-974271614-project-member] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 973.345365] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 973.345698] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.345819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.345889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.346181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.346344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.346443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.346611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.346796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.346885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.346981] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.350030] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.350261] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.350422] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.350597] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.350886] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-28bb2fdd-21a0-4ae9-a72e-2387756c6036 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.351070] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.351197] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.351497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.351657] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28bb2fdd-21a0-4ae9-a72e-2387756c6036',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.654835] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.654835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.654835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.655031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.655239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.655350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.655350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.655968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.655968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.655968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.655968] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.655968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.655968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.656290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.656290] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.656290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.656410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.658248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.658248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.658248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.658248] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.825738] env[69219]: INFO networking_nsxv3.common.synchronization [req-78cefea8-bf5c-46cc-be0f-44b4dfbc80d2 req-d536fc9c-12e0-4260-b358-dc67f0aa110f tempest-ListServerFiltersTestJSON-897971295 tempest-ListServerFiltersTestJSON-897971295-project-member] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 973.825738] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 973.825970] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.826059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.826136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.826360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.826586] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.826703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.826765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.826917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.827009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.827668] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.850982] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.850982] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.850982] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 already deleted. [ 973.850982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.858923] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.859058] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.859187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.859482] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.859642] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.859800] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 28bb2fdd-21a0-4ae9-a72e-2387756c6036 not found, creating... [ 973.860109] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.860335] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.860461] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.860716] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.860904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.861205] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.861412] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.861548] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.861792] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.861963] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.862938] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 28bb2fdd-21a0-4ae9-a72e-2387756c6036 is going to be created. [ 973.884176] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.884542] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.884655] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.884987] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.885737] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.885737] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.923033] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.923033] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.923033] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.923033] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.923640] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.923982] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.924237] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.924574] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.924835] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.925357] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.927021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.927021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.927021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.927021] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 973.927021] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.927021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.951270] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.951454] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 973.952083] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.952323] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.952781] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.952973] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.953121] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.953437] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.953574] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8d4a76-79d8-4864-94c3-e4e7654d18fa',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.160038] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98: rpc.has_security_group_logging(os_id): False [ 974.178072] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.178236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.178307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.178513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.178611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.178807] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.178905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.178961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.179157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.179196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.179366] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.179459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.179516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.179655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.179715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.179896] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.179984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.180046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.180198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.180282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.180364] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be created. [ 974.224513] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 in Status: SUCCESS [ 974.224513] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 deletion is rescheduled due to dependency. [ 974.224513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.237544] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.237544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.237544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.237544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.237544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.246281] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: IN_PROGRESS for 2s [ 974.330243] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.447267] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 974.447497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.456305] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.456761] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.456761] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.457017] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.457194] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.457357] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 3d8d4a76-79d8-4864-94c3-e4e7654d18fa not found, creating... [ 974.457634] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.457813] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.457938] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.458230] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.458377] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.458668] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.458831] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.458952] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.459605] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.459836] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.460072] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa is going to be created. [ 974.492902] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.493254] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.493365] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.493732] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.494046] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.494390] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.641541] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 974.641994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.835252] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.917296] env[69219]: INFO networking_nsxv3.common.synchronization [req-89a8b565-4b9a-402e-b6b8-02b881ca978e req-d90545f3-136e-4f5c-b6f9-10d89291af3f service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 974.917296] env[69219]: INFO networking_nsxv3.common.synchronization [req-89a8b565-4b9a-402e-b6b8-02b881ca978e req-d90545f3-136e-4f5c-b6f9-10d89291af3f service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 974.917296] env[69219]: INFO networking_nsxv3.common.synchronization [req-89a8b565-4b9a-402e-b6b8-02b881ca978e req-d90545f3-136e-4f5c-b6f9-10d89291af3f service nova] Enqueued Resource ID: 28bb2fdd-21a0-4ae9-a72e-2387756c6036 with Priority: HIGHEST for action port [ 974.917296] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 974.918017] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 974.918386] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bb2fdd-21a0-4ae9-a72e-2387756c6036 with Priority: HIGHEST for action port [ 974.919219] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.919493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.919791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.920142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.920360] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.921800] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.924225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.924225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.924225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.924225] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.924225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.924225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.924225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.924225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.924225] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.924225] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-28bb2fdd-21a0-4ae9-a72e-2387756c6036 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.926584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.926584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.926584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.926584] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28bb2fdd-21a0-4ae9-a72e-2387756c6036',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.179322] env[69219]: INFO networking_nsxv3.common.synchronization [req-df74f2cc-335c-482a-b37b-6b6754cfd206 req-662300e8-36d8-4eac-94d2-ea204261b2c5 service nova] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_rules [ 975.179322] env[69219]: INFO networking_nsxv3.common.synchronization [req-df74f2cc-335c-482a-b37b-6b6754cfd206 req-662300e8-36d8-4eac-94d2-ea204261b2c5 service nova] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 975.179322] env[69219]: INFO networking_nsxv3.common.synchronization [req-df74f2cc-335c-482a-b37b-6b6754cfd206 req-662300e8-36d8-4eac-94d2-ea204261b2c5 service nova] Enqueued Resource ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa with Priority: HIGHEST for action port [ 975.179842] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_rules [ 975.180210] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 975.181422] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa with Priority: HIGHEST for action port [ 975.181422] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.181952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.181952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.183400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.183400] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.184806] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.186125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.186125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.186125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.186125] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.186125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.186125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.186125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.186125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.186125] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.189235] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.189235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.189235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.189235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.189235] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8d4a76-79d8-4864-94c3-e4e7654d18fa',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.337538] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.337890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.337890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.338237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.338237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.338303] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 975.357256] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: SUCCESS [ 975.357510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.368972] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.369182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.369253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.369415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.369809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.381554] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 975.427172] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.427438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.427584] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.428606] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28bb2fdd-21a0-4ae9-a72e-2387756c6036 with status ACTIVE [ 975.428849] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.428995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.429281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.429560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.429725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.430043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.430726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.430726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.430726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.430726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.432043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.432043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.432043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.432043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.432043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.432043] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28bb2fdd-21a0-4ae9-a72e-2387756c6036 is going to be updated. [ 975.455460] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.455649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.455706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.455884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.456050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.456639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28bb2fdd-21a0-4ae9-a72e-2387756c6036" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.690337] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.690337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.690810] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.692686] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d8d4a76-79d8-4864-94c3-e4e7654d18fa with status ACTIVE [ 975.693529] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.693864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.694963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.696474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.696630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.696858] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.696968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.697044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.697220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.697303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.697519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.697616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.697682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.697844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.697918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.698024] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa is going to be updated. [ 975.725012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.725613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.725771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.726044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.726206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.726437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.934800] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.202336] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.257128] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: SUCCESS [ 976.257128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.440104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.440409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.440409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.440627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.440719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.440819] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 976.468420] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.468566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.468638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.468849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.469010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.479555] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 976.706450] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.706450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.706450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.706646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.706722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.706851] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be created. [ 976.733215] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.733470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.733470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.733634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.733790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.745861] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: UNINITIALIZED for 2s [ 976.789476] env[69219]: INFO networking_nsxv3.common.synchronization [req-d9e1178c-2faf-49e9-bb88-d9cf5230841a req-d0862ed5-c66d-4766-b5cd-5b10c4d7411d tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 976.790237] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 976.790356] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.790431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.790431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.790809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.790809] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.790967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.790967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.791815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.791815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.791815] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.295650] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.391496] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 977.391736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.798298] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.302575] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.302760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.302852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.303611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.303807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.303964] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 978.334308] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.334389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.334505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.334757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.334940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.347813] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 978.492942] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 978.493244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.493465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.493720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.493962] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.494126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.494212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.495084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.495084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.495084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.495084] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.758399] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.758399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.758399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.758399] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.928248] env[69219]: INFO networking_nsxv3.common.synchronization [req-daa65c33-cd34-40c0-baab-506e2b6c7210 req-6b54a8cf-e5c9-4803-bcd5-4cafb7b0d773 tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 978.931055] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 978.931055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.931055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.931055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.931055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.931055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.931055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.931055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.931055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.931055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.934906] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.001063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.001271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.001393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.001652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.002129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.002129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.002129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.002129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.002339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.002339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.002463] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.002559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.002619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.003101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.003101] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.003101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.003101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.003247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.004030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.004030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.004030] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.260732] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.261017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.261119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.261421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.261660] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.261837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.261930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.262169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.262280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.263389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.263532] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.263648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.263721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.267130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.267130] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.267130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.267130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.267130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.267130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.267130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.267130] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.328052] env[69219]: INFO networking_nsxv3.common.synchronization [None req-145e24ff-3ce3-4ac5-9268-182b0140a7c8 None None] Enqueued Resource ID: 0c283601-5587-40e8-9dd8-375e65b2eb65 with Priority: HIGHEST for action port [ 979.334876] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c283601-5587-40e8-9dd8-375e65b2eb65 with Priority: HIGHEST for action port [ 979.334876] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c283601-5587-40e8-9dd8-375e65b2eb65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.334876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c283601-5587-40e8-9dd8-375e65b2eb65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.334876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c283601-5587-40e8-9dd8-375e65b2eb65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.335174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c283601-5587-40e8-9dd8-375e65b2eb65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.336028] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c283601-5587-40e8-9dd8-375e65b2eb65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.436404] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.506143] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0687614d-5fbe-486f-942e-47e8dcdc82e2: rpc.has_security_group_logging(os_id): False [ 979.523561] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.523721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.523793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.524035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.524169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.524329] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.524562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.524562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.524655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.524710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.524884] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.524977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.525056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.525195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.525271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.525458] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.525550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.525612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.525748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.525823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.525906] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 979.585940] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.586121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.586204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.586610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.586610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.616252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 979.768796] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4620fe61-858f-4c22-8abc-d5f135e99e49: rpc.has_security_group_logging(os_id): False [ 979.791144] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.791796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.791796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.791796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.791796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.792016] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.792016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.792016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.792182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.792337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.792472] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.792714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.792714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.792865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.792865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.793879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.794045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.794113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.794272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.794353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.794443] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be created. [ 979.840063] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c283601-5587-40e8-9dd8-375e65b2eb65 [ 979.840397] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.840565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.840713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.840864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.840955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.841100] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c283601-5587-40e8-9dd8-375e65b2eb65 already deleted. [ 979.841148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c283601-5587-40e8-9dd8-375e65b2eb65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.862721] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.862721] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.862721] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.862721] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.862721] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.862721] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.862721] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.863335] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.863374] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.863616] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.863776] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.863905] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.864036] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.864155] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.864341] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.865521] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.866649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.866649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.866812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.866862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.867368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.878157] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 979.887367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.887536] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.887790] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.887957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.888782] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-adb401d5-68a9-4965-b60c-0e83a5b50155 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.889416] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.889569] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.890743] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.890743] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb401d5-68a9-4965-b60c-0e83a5b50155',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.939330] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.358937] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 980.358937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.392738] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.392884] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.393020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.394162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.394162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.394162] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port adb401d5-68a9-4965-b60c-0e83a5b50155 not found, creating... [ 980.394317] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.394740] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.396015] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.396015] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.396456] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.397279] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.399788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.399788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.399788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.399788] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.399788] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: adb401d5-68a9-4965-b60c-0e83a5b50155 is going to be created. [ 980.417406] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.417923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.417923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.418094] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.418288] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.418516] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.441892] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.442162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.443145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.443432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.443552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.443714] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 980.475455] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.475616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.475674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.475886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.476056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.486760] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 981.441026] env[69219]: INFO networking_nsxv3.common.synchronization [None req-13f3c88e-a12a-44e0-a4c1-62f630af5e1d None None] Enqueued Resource ID: f0e9dff5-7ba1-4e82-b292-0b1dbd343078 with Priority: HIGHEST for action port [ 981.441380] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0e9dff5-7ba1-4e82-b292-0b1dbd343078 with Priority: HIGHEST for action port [ 981.442604] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0e9dff5-7ba1-4e82-b292-0b1dbd343078 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.445556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0e9dff5-7ba1-4e82-b292-0b1dbd343078" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.445629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0e9dff5-7ba1-4e82-b292-0b1dbd343078" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.445881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0e9dff5-7ba1-4e82-b292-0b1dbd343078" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.446825] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0e9dff5-7ba1-4e82-b292-0b1dbd343078',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.455912] env[69219]: INFO networking_nsxv3.common.synchronization [req-daa65c33-cd34-40c0-baab-506e2b6c7210 req-a4ab0b21-57c0-47f8-9ad1-fbd209a87406 service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 981.456136] env[69219]: INFO networking_nsxv3.common.synchronization [req-daa65c33-cd34-40c0-baab-506e2b6c7210 req-a4ab0b21-57c0-47f8-9ad1-fbd209a87406 service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 981.456244] env[69219]: INFO networking_nsxv3.common.synchronization [req-daa65c33-cd34-40c0-baab-506e2b6c7210 req-a4ab0b21-57c0-47f8-9ad1-fbd209a87406 service nova] Enqueued Resource ID: adb401d5-68a9-4965-b60c-0e83a5b50155 with Priority: HIGHEST for action port [ 981.456488] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 981.456627] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 981.456719] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb401d5-68a9-4965-b60c-0e83a5b50155 with Priority: HIGHEST for action port [ 981.457311] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.457378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.457446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.457636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.457742] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.458738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.458801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.459092] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-adb401d5-68a9-4965-b60c-0e83a5b50155 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.459092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.459197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.460018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.460018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb401d5-68a9-4965-b60c-0e83a5b50155',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.624165] env[69219]: INFO networking_nsxv3.common.synchronization [req-0189a477-3a0b-47a5-8c6a-d45f863f4a66 req-e71040e5-f2ec-4b1e-8656-52932a976042 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 981.624675] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 981.625137] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.625137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.625259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.625360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.625520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.625611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.625672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.625817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.625899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.625990] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.630855] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 981.631018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.894087] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 981.896093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.948348] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0e9dff5-7ba1-4e82-b292-0b1dbd343078 [ 981.948616] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.948767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.948869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.949110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.949198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.949309] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0e9dff5-7ba1-4e82-b292-0b1dbd343078 already deleted. [ 981.949403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0e9dff5-7ba1-4e82-b292-0b1dbd343078" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.963483] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.963483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.963483] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adb401d5-68a9-4965-b60c-0e83a5b50155 with status ACTIVE [ 981.963483] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.963483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.963483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.963483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.963483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.963483] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.963825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.963825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.963825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.963913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.964837] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.964837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.964939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.965578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.965666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.965795] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adb401d5-68a9-4965-b60c-0e83a5b50155 is going to be updated. [ 981.986403] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.986556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.986612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.986819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.986959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.987143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adb401d5-68a9-4965-b60c-0e83a5b50155" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.131116] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.131116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.131116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.131496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.131605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.131839] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.132031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.132031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.132139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.132185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.132253] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 982.163167] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.163393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.163504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.163818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.164056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.179067] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 982.324950] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.325123] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.325269] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.325535] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.325806] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.325951] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.326140] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.326430] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.326558] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.326780] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.326902] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.327397] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.327397] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.327397] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 982.327397] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.327636] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.351556] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.351556] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 982.351556] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.351556] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.351756] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.351819] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.353605] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.353605] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.353605] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cc9eab9-6dc1-43ba-ac08-dcc27117da98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.500072] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 982.500415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.500514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.500731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.500921] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.501089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.501187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.501371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.501456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.501553] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.858184] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.858184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.858184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.858184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.858184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.858184] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 0cc9eab9-6dc1-43ba-ac08-dcc27117da98 not found, creating... [ 982.858184] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.858184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.858184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.859255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.859592] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.862063] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.862063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.862063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.862063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.862063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.862063] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 0cc9eab9-6dc1-43ba-ac08-dcc27117da98 is going to be created. [ 982.881349] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.883021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.883021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.883021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.883021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.883371] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.005103] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.511319] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.013274] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.013438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.013509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.013727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.013826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.013919] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 984.042968] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.043139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.043205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.043424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.043572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.054479] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 984.190032] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 984.190644] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 984.190644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.245124] env[69219]: INFO networking_nsxv3.common.synchronization [None req-970eab1f-5135-4af6-ac5f-51de534be6e3 None None] Enqueued Resource ID: 3fc2533a-2393-43ab-86b8-f6a756e6774e with Priority: HIGHEST for action port [ 984.245124] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fc2533a-2393-43ab-86b8-f6a756e6774e with Priority: HIGHEST for action port [ 984.245124] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fc2533a-2393-43ab-86b8-f6a756e6774e taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.245124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fc2533a-2393-43ab-86b8-f6a756e6774e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.245124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fc2533a-2393-43ab-86b8-f6a756e6774e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.245855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fc2533a-2393-43ab-86b8-f6a756e6774e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.245942] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc2533a-2393-43ab-86b8-f6a756e6774e',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.283324] env[69219]: INFO networking_nsxv3.common.synchronization [req-0189a477-3a0b-47a5-8c6a-d45f863f4a66 req-1927c527-c8eb-4940-bb42-66dfeb33b7c9 service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 984.283478] env[69219]: INFO networking_nsxv3.common.synchronization [req-0189a477-3a0b-47a5-8c6a-d45f863f4a66 req-1927c527-c8eb-4940-bb42-66dfeb33b7c9 service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 984.283727] env[69219]: INFO networking_nsxv3.common.synchronization [req-0189a477-3a0b-47a5-8c6a-d45f863f4a66 req-1927c527-c8eb-4940-bb42-66dfeb33b7c9 service nova] Enqueued Resource ID: 0cc9eab9-6dc1-43ba-ac08-dcc27117da98 with Priority: HIGHEST for action port [ 984.284100] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 984.284279] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 984.284279] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc9eab9-6dc1-43ba-ac08-dcc27117da98 with Priority: HIGHEST for action port [ 984.284564] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.284656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.284767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.285038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.286743] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.287669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.288288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.288288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.288288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.288288] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.288531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.288531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.288531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.288629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.288930] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.289850] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.289964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.302024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.302024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.302024] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cc9eab9-6dc1-43ba-ac08-dcc27117da98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.748434] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fc2533a-2393-43ab-86b8-f6a756e6774e [ 984.748729] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.748881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.748881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.749126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.749220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.749331] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fc2533a-2393-43ab-86b8-f6a756e6774e already deleted. [ 984.749414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fc2533a-2393-43ab-86b8-f6a756e6774e" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.801928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.802707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.802915] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.804290] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0cc9eab9-6dc1-43ba-ac08-dcc27117da98 with status ACTIVE [ 984.804500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.804605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.804670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.804947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.805074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.805260] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.805349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.805415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.805581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.805655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.805833] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.805943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.805993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.806239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.806239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.806344] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0cc9eab9-6dc1-43ba-ac08-dcc27117da98 is going to be updated. [ 984.829017] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.829017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.829017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.829017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.829017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.829017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cc9eab9-6dc1-43ba-ac08-dcc27117da98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.959415] env[69219]: INFO networking_nsxv3.common.synchronization [None req-00a58455-c43f-4c93-8793-0a3da8ec4db1 None None] Enqueued Resource ID: 99e9df50-be37-4019-8878-f21b9b59eefb with Priority: HIGHEST for action port [ 984.960344] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99e9df50-be37-4019-8878-f21b9b59eefb with Priority: HIGHEST for action port [ 984.962052] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-99e9df50-be37-4019-8878-f21b9b59eefb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.962052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99e9df50-be37-4019-8878-f21b9b59eefb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.962052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99e9df50-be37-4019-8878-f21b9b59eefb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.965237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99e9df50-be37-4019-8878-f21b9b59eefb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.965237] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99e9df50-be37-4019-8878-f21b9b59eefb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.306065] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.467855] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99e9df50-be37-4019-8878-f21b9b59eefb [ 985.467855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.467855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.467855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.467855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.467855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.467855] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99e9df50-be37-4019-8878-f21b9b59eefb already deleted. [ 985.467855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99e9df50-be37-4019-8878-f21b9b59eefb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.809453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.809852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.809944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.810417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.810549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.810689] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 985.844967] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.845254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.845254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.845473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.845704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.858913] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 985.998330] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7c2a2b5c-8b92-4b51-870c-29da1e3f32a7 tempest-ServersV294TestFqdnHostnames-1201944735 tempest-ServersV294TestFqdnHostnames-1201944735-project-member] Enqueued Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_rules [ 985.998873] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_rules [ 985.999485] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.000232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.000958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.000958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.000958] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.064101] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.064101] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.064101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.065012] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.099017] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2ec967ca-30ca-4ed7-8de9-c1e8abc7750f tempest-ServersV294TestFqdnHostnames-1201944735 tempest-ServersV294TestFqdnHostnames-1201944735-project-member] Enqueued Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_rules [ 986.099643] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_rules [ 986.100022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.102197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.521792] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.521979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.522063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.522228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.522320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.522425] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfae446e-9362-456c-b5ff-375627350736 already deleted. [ 986.522516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.522691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.522860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.522960] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.568453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.568629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.568704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.569164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.569207] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.569317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.569383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.569552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.569644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.569731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.569880] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.569975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.570047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.570192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.570367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.570455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.570519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.570719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.570809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.570893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.570982] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.836083] env[69219]: INFO networking_nsxv3.common.synchronization [None req-1d2c256f-e551-4a8b-896a-1cbeb3be0c78 tempest-MigrationsAdminTest-1548575404 tempest-MigrationsAdminTest-1548575404-project-member] Enqueued Resource ID: ede79118-e044-4bfa-9f51-442b712112e7 with Priority: HIGHEST for action security_group_rules [ 986.836083] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede79118-e044-4bfa-9f51-442b712112e7 with Priority: HIGHEST for action security_group_rules [ 986.836083] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ede79118-e044-4bfa-9f51-442b712112e7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.836083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.836083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.838024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.841527] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ede79118-e044-4bfa-9f51-442b712112e7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.045706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.045706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.045706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.045706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.045706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.045706] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfae446e-9362-456c-b5ff-375627350736 already deleted. [ 987.045706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.075850] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df327ac5-73cd-478c-b19b-3849894e070d: rpc.has_security_group_logging(os_id): False [ 987.095152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.096279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.096279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.096279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.120015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.120726] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.120726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.120726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.120947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.120947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.121262] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.121541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.121541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.121656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.121656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.121847] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.121935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.121998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.123929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.123996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.124090] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 987.183138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.183406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.183406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.183557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.183826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.197660] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 987.272326] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8a770299-a761-4b73-bbe0-4895b35e69ab None None] Enqueued Resource ID: ccfcaf73-6b5d-4504-963e-9ce053dabd4b with Priority: HIGHEST for action port [ 987.272947] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccfcaf73-6b5d-4504-963e-9ce053dabd4b with Priority: HIGHEST for action port [ 987.273302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccfcaf73-6b5d-4504-963e-9ce053dabd4b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.273402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccfcaf73-6b5d-4504-963e-9ce053dabd4b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.273468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccfcaf73-6b5d-4504-963e-9ce053dabd4b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.273815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccfcaf73-6b5d-4504-963e-9ce053dabd4b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.273885] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccfcaf73-6b5d-4504-963e-9ce053dabd4b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.293220] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7f2814b4-bfa2-4d28-b48f-041d6f50c7d8 tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 987.294881] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 987.295525] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.295667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.295754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.296040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.296130] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.308455] env[69219]: INFO networking_nsxv3.common.synchronization [None req-531c4ab9-e1b1-44ae-b95d-734be6dc1094 tempest-MigrationsAdminTest-1548575404 tempest-MigrationsAdminTest-1548575404-project-member] Enqueued Resource ID: ede79118-e044-4bfa-9f51-442b712112e7 with Priority: HIGHEST for action security_group_rules [ 987.311634] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede79118-e044-4bfa-9f51-442b712112e7 with Priority: HIGHEST for action security_group_rules [ 987.311634] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ede79118-e044-4bfa-9f51-442b712112e7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.311634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.368453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.369055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.369055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.369055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.369055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.369294] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ede79118-e044-4bfa-9f51-442b712112e7 already deleted. [ 987.369294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.369376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.369501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.370285] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ede79118-e044-4bfa-9f51-442b712112e7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.386226] env[69219]: INFO networking_nsxv3.common.synchronization [None req-04642f5e-e1b9-4627-833d-ecfba12802ea tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 987.386761] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 987.387256] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.387256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.777084] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ccfcaf73-6b5d-4504-963e-9ce053dabd4b [ 987.777338] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.777473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.777544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.777768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.777873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.777969] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ccfcaf73-6b5d-4504-963e-9ce053dabd4b already deleted. [ 987.778068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccfcaf73-6b5d-4504-963e-9ce053dabd4b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.792527] env[69219]: INFO networking_nsxv3.common.synchronization [None req-be7d8e75-6467-441b-a66f-996e021c3c4b None None] Enqueued Resource ID: cdd74303-8c3c-4137-aec4-9ab0b5388a2c with Priority: HIGHEST for action port [ 987.793216] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdd74303-8c3c-4137-aec4-9ab0b5388a2c with Priority: HIGHEST for action port [ 987.793666] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdd74303-8c3c-4137-aec4-9ab0b5388a2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.793843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdd74303-8c3c-4137-aec4-9ab0b5388a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.793917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdd74303-8c3c-4137-aec4-9ab0b5388a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.794297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdd74303-8c3c-4137-aec4-9ab0b5388a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.794388] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd74303-8c3c-4137-aec4-9ab0b5388a2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.817704] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.817858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.817901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.818205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.818205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.818373] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 already deleted. [ 987.818373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.818541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.818699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.818779] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.871233] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 987.872185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.872185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.872185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.872185] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.872185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.872621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.872621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.872700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.872740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.873020] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.892785] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.892785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.893229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.893229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.893396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.893808] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ede79118-e044-4bfa-9f51-442b712112e7 already deleted. [ 987.893979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ede79118-e044-4bfa-9f51-442b712112e7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.297456] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdd74303-8c3c-4137-aec4-9ab0b5388a2c [ 988.297456] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.297456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.297456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.297456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.297456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.297456] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdd74303-8c3c-4137-aec4-9ab0b5388a2c already deleted. [ 988.297456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdd74303-8c3c-4137-aec4-9ab0b5388a2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.341204] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.342777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.342777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.342777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.342777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.342777] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 already deleted. [ 988.342777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.376371] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.379899] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.379899] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.379899] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.379899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.380648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.380648] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.882837] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03b383a8-62e8-454b-9d3c-ac3de2f9ba05: rpc.has_security_group_logging(os_id): False [ 988.907540] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.907540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.907540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.907540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.907540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.907540] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.907540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.907540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.907540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.908544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.908544] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.908544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.908544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.908544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.908544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.909660] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.909660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.909660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.909660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.909660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.909660] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 988.966305] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.966608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.966608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.966812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.966908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.980387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 989.216156] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 989.216384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.371345] env[69219]: INFO networking_nsxv3.common.synchronization [req-85f1bc58-0239-4cca-915b-3678ecd3dff6 req-645deb84-230c-4942-836a-aaad51f4d3c3 tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 989.380340] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 989.380340] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.380340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.380340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.380340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.380340] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.380340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.380340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.380340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.380340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.380340] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.611595] env[69219]: INFO networking_nsxv3.common.synchronization [req-6d31440e-03b8-4258-b560-17bb46ca06a3 req-cd5746d5-cbbc-4b24-9d2e-d3ed02391e8f tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_members [ 989.611757] env[69219]: INFO networking_nsxv3.common.synchronization [req-6d31440e-03b8-4258-b560-17bb46ca06a3 req-cd5746d5-cbbc-4b24-9d2e-d3ed02391e8f tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 989.611924] env[69219]: INFO networking_nsxv3.common.synchronization [req-6d31440e-03b8-4258-b560-17bb46ca06a3 req-cd5746d5-cbbc-4b24-9d2e-d3ed02391e8f tempest-SecurityGroupsTestJSON-1038325561 tempest-SecurityGroupsTestJSON-1038325561-project-member] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 989.612433] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGHEST for action security_group_members [ 989.612575] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGHEST for action security_group_members [ 989.612675] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGHEST for action security_group_members [ 989.613188] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-3afd8a02-3b29-4be8-aae2-a4f15df4f234 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.613453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.613595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.613861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.614085] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.614669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.614803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.615061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.615209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.615369] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.616514] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.616754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.616870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.617082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.617466] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.617654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.617727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.617877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.617960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.618064] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.618852] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.618961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.619041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.619200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.619398] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.619519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.619887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.619887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.619887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.619887] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.864266] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.865879] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.866283] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.866705] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.867122] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.867485] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.867780] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.868162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.868473] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.868801] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.869052] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.869277] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.869491] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.869703] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.869904] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.870159] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.882883] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.882883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.882883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.882883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.887692] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.887988] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 989.888117] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.888345] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-637" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.888762] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b40dcadc-d8df-428d-8428-00f135ec09b5 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.888922] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.889349] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.889493] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.889627] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40dcadc-d8df-428d-8428-00f135ec09b5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.902855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.902855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.903720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.903720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.903720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.903720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.903720] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be updated. [ 989.928546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.928710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.928753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.928950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.929100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.936634] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 990.128867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.128867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.128867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.128867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.128867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.128867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.128867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.128867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.146299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.146392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.146483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.146613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.146810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.146892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.146994] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 is going to be updated. [ 990.147990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.148201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.148285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.148505] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.148643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.148706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.148868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.148936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.149056] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be updated. [ 990.149877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.150050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.175735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.176055] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.176238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.176305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.176517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.176606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.176696] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be updated. [ 990.178469] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.178600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.178672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.178835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.178960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.180789] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.180902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.180971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.181146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.181261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.191199] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: IN_PROGRESS for 2s [ 990.191847] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: IN_PROGRESS for 2s [ 990.203860] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.204013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.204106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.204279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.204422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.211524] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: IN_PROGRESS for 2s [ 990.395025] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.395025] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b40dcadc-d8df-428d-8428-00f135ec09b5 not found, creating... [ 990.395025] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.395025] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.395594] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.395594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.395594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.395594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.395594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.395594] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b40dcadc-d8df-428d-8428-00f135ec09b5 is going to be created. [ 990.414791] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.415083] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.415083] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.513459] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.513459] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.513459] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.640057] env[69219]: INFO networking_nsxv3.common.synchronization [req-95227299-f1c5-4af7-a07d-f43543663f9d req-ec26a294-46a8-486c-ad7b-bf74eea521d8 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 990.640698] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 990.642301] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.642301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.642301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.642301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.642301] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.642301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.642301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.642301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.642301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.642632] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.993634] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 990.993956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.148819] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.180642] env[69219]: INFO networking_nsxv3.common.synchronization [req-85f1bc58-0239-4cca-915b-3678ecd3dff6 req-323d3c11-2b6f-4bc9-a736-600a6530253b service nova] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_rules [ 991.180822] env[69219]: INFO networking_nsxv3.common.synchronization [req-85f1bc58-0239-4cca-915b-3678ecd3dff6 req-323d3c11-2b6f-4bc9-a736-600a6530253b service nova] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 991.180970] env[69219]: INFO networking_nsxv3.common.synchronization [req-85f1bc58-0239-4cca-915b-3678ecd3dff6 req-323d3c11-2b6f-4bc9-a736-600a6530253b service nova] Enqueued Resource ID: b40dcadc-d8df-428d-8428-00f135ec09b5 with Priority: HIGHEST for action port [ 991.182072] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_rules [ 991.182501] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 991.182501] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40dcadc-d8df-428d-8428-00f135ec09b5 with Priority: HIGHEST for action port [ 991.182708] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.182845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.182845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.183074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.183163] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.184131] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.184407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.184667] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40dcadc-d8df-428d-8428-00f135ec09b5 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.184781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.184847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.185054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.185217] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40dcadc-d8df-428d-8428-00f135ec09b5',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.655585] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.687465] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.687734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.687801] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b40dcadc-d8df-428d-8428-00f135ec09b5 with status ACTIVE [ 991.687927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.688065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.688110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.688394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.688496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.688671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.688762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.688874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.688980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.689072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.689259] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.689369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.689425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.689565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.689636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.689718] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b40dcadc-d8df-428d-8428-00f135ec09b5 is going to be updated. [ 991.716109] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.716324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.716394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.716591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.716737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.716993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40dcadc-d8df-428d-8428-00f135ec09b5" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.947152] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 991.947152] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 deletion is rescheduled due to dependency. [ 991.947349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.947474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.947723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.947981] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.948151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.948271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.948406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.948493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.948606] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.019732] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-1e88f2d4-7024-490d-9714-29e74cbfc3bc tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 992.020865] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 992.020865] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.021067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.021115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.021345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.021540] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.021674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.021739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.022235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.022327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.022459] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.157987] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.158185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.158278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.158540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.158688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.158807] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 992.190160] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.191829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.192107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.192410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.192806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.207097] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 992.208614] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd in Status: SUCCESS [ 992.208758] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd deletion is rescheduled due to dependency. [ 992.208866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.209597] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 in Status: SUCCESS [ 992.209789] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 deletion is rescheduled due to dependency. [ 992.210589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.222039] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 in Status: SUCCESS [ 992.222236] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 deletion is rescheduled due to dependency. [ 992.222358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.452415] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.483300] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-84979844-69c2-4a67-9a57-006b5c6d5fb6 tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 992.483917] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 992.484209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.484313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.525492] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.525686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.525738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.525936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.549419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.549633] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.549765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.549823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.550045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.550223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.550223] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 992.591095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.591403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.591403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.591689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.591859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.602817] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 992.682208] env[69219]: INFO networking_nsxv3.common.synchronization [None req-b5e871ae-5a03-4ceb-a311-840a175c2f6b tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 992.682208] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 992.682208] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.682348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.955587] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.066142] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.066142] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-521" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.066716] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-521" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.067359] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-521" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.068030] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.068030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.071158] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.071158] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.071158] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.071158] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.071158] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.071158] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.071158] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.071158] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.071158] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.071158] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.093058] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.093271] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.093444] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.093665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-521" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.094018] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-6ac3550b-d93d-4c4f-b73a-92947c936a85 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.095020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.095020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.095020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.095020] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ac3550b-d93d-4c4f-b73a-92947c936a85',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.459829] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.462232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.462232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.462232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.462232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.462232] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be updated. [ 993.491035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.491200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.491200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.491366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.491605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.500503] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 993.603443] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.603703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.603838] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.604261] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.604547] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.604754] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 6ac3550b-d93d-4c4f-b73a-92947c936a85 not found, creating... [ 993.605117] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.605295] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.605431] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.605713] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.605885] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.609571] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.609789] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.610015] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.610181] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.610355] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.610552] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 6ac3550b-d93d-4c4f-b73a-92947c936a85 is going to be created. [ 993.635109] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.635335] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.635483] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.635734] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.635969] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.639136] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.220376] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 994.220376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.220376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.220376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.220961] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.220961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.220961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.220961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.220961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.220961] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.620348] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 994.620583] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca deletion is rescheduled due to dependency. [ 994.620747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.620947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.621209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.621543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.621750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.621820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.621991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.622090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.622190] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.724164] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.724354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.724444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.727140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.727140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.727140] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.727140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.727140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.727140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.727140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.727140] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 994.748849] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-a9bc7379-afb5-4727-949c-cf8a1234d930 service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 994.749337] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-a9bc7379-afb5-4727-949c-cf8a1234d930 service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 994.749337] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-a9bc7379-afb5-4727-949c-cf8a1234d930 service nova] Enqueued Resource ID: 6ac3550b-d93d-4c4f-b73a-92947c936a85 with Priority: HIGHEST for action port [ 994.749537] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 994.749625] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 994.749730] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3550b-d93d-4c4f-b73a-92947c936a85 with Priority: HIGHEST for action port [ 994.750770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.750770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.750770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.751035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.751373] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.752323] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.753420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.753420] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ac3550b-d93d-4c4f-b73a-92947c936a85 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.753420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.753420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.753420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.753420] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ac3550b-d93d-4c4f-b73a-92947c936a85',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.755142] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.755229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.755318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.755515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.755768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.769023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 995.124731] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.258523] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.258523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.263026] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ac3550b-d93d-4c4f-b73a-92947c936a85 with status ACTIVE [ 995.263026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.263026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.263026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.263026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.263026] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ac3550b-d93d-4c4f-b73a-92947c936a85 is going to be updated. [ 995.288289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.288289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.288289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.288289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.288289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.288289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ac3550b-d93d-4c4f-b73a-92947c936a85" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.512655] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.512655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.512655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.512655] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.627361] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.835674] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-213 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.835962] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-213" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.836103] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-213" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.836498] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-213" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.836694] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.836858] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.837016] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.841156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.841156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.841156] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.841156] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.841156] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.841156] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.841156] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 995.841156] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.841156] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.867620] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.867620] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 995.867620] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.867620] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-213" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.867620] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.867957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.867957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.868904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.868904] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.020820] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.021026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.021102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.021559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.021828] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.021957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.022050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.022809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.022926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.023060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.024431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.024431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.024431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.024861] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.130021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.130209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.130407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.130660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.130780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.130886] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 996.169219] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.169416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.169416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.170426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.170426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.186527] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 996.373678] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.373678] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 not found, creating... [ 996.373678] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.373678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.374999] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.374999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.374999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.375217] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.375445] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.375692] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 is going to be created. [ 996.398500] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.398500] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.398500] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.398500] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.398500] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.398500] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.479116] env[69219]: INFO networking_nsxv3.common.synchronization [req-5d6941ff-7e8a-4daa-9125-0b555d26fb56 req-ecfd102c-9fb7-4cfd-8d5e-3309dc0355e4 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_members [ 996.480263] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGHEST for action security_group_members [ 996.480263] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.480263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.480499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.480652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.480821] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.480930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.480994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.481159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.481257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.481655] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.529201] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 825c0c18-33c1-4cb4-8480-e8d82499bbf3: rpc.has_security_group_logging(os_id): False [ 996.548247] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.548247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.548247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.548247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.548629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.548629] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.548629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.548786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.548841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.548919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.549117] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.549219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.549279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.549994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.549994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.549994] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.549994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.549994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.549994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.549994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.550404] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be updated. [ 996.652047] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.652047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.652047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.652047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.652047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.665546] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 996.777678] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 996.778184] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 deletion is rescheduled due to dependency. [ 996.778429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.985615] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.985883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.986636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.986947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.010226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.010939] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.011206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.011328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.011657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.011830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.012031] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d is going to be updated. [ 997.040048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.040424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.040424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.040627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.040786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.067162] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d in Status: IN_PROGRESS for 2s [ 997.328791] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-3063cfd1-a81c-48ff-8830-9a4f5a978c8b service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 997.331037] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-3063cfd1-a81c-48ff-8830-9a4f5a978c8b service nova] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 997.331037] env[69219]: INFO networking_nsxv3.common.synchronization [req-ec7627b7-8d13-4b9f-a04f-208a4592c836 req-3063cfd1-a81c-48ff-8830-9a4f5a978c8b service nova] Enqueued Resource ID: 67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 with Priority: HIGHEST for action port [ 997.331037] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_rules [ 997.331037] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 997.331037] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 with Priority: HIGHEST for action port [ 997.331037] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.331586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.331997] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.332210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.332506] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.332747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.334247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.334247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.334247] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.838657] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 with status ACTIVE [ 997.838899] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.839038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.839133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.839368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.839464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.839663] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.839764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.839820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.839962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.840052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.840238] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.840368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.840411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.840561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.840666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.840783] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89 is going to be updated. [ 997.877099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.877195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.877241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.877855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.877855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.878156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67b2f70a-989b-4ec8-a9f6-f3d3cf0f0e89" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.196369] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 998.196614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.196783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.197192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.197401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.197401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.197401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.197527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.197681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.197735] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.229823] env[69219]: INFO networking_nsxv3.common.synchronization [req-7877a563-4445-405a-9f6e-07b7980b24df req-343bf205-fb09-4728-907f-6fe13f251a72 tempest-ServersWithSpecificFlavorTestJSON-1490539426 tempest-ServersWithSpecificFlavorTestJSON-1490539426-project-member] Enqueued Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 998.230672] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4746a8-624d-411a-b8a7-b5c965021a51 with Priority: HIGHEST for action security_group_members [ 998.231103] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd4746a8-624d-411a-b8a7-b5c965021a51 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.231229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.231295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.231500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.231656] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.231753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.231813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.231976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.232080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.233040] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd4746a8-624d-411a-b8a7-b5c965021a51',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.683459] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 998.683732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.703534] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.737538] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.737538] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.737538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.737538] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 is going to be updated. [ 998.783047] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.783047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.783047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.783047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.783047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.794577] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: IN_PROGRESS for 2s [ 999.080566] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d in Status: SUCCESS [ 999.080566] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d deletion is rescheduled due to dependency. [ 999.080566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.205767] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.391815] env[69219]: INFO networking_nsxv3.common.synchronization [req-0f2bbc4b-8626-45b3-8bb8-f4833f9ce552 req-d2d77643-93a5-474b-ba4a-0bc0246242af tempest-ServerRescueTestJSON-570394754 tempest-ServerRescueTestJSON-570394754-project-member] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 999.393762] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGHEST for action security_group_members [ 999.393942] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.395098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.395098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.395098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.395098] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.395098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.395098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.395098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.395098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.395098] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.708685] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.708861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.708904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.709166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.709264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.709889] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 999.737734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.737922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.737997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.738258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.738407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.747521] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 999.898941] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.899159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.899219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.899404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.899503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.899713] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.899818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.899873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.900043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.900123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.900209] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be updated. [ 999.923950] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.924091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.924165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.924551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.924779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.933373] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: IN_PROGRESS for 2s [ 1000.366853] env[69219]: INFO networking_nsxv3.common.synchronization [req-fa767c46-5a3e-4952-8d00-747a2625fd55 req-7acf9bd1-c196-4253-81a8-5334ec044bb6 tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1000.367417] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1000.367753] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.367891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.367962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.370234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.370428] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.370562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.370631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.370771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.370856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.370949] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.804387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd4746a8-624d-411a-b8a7-b5c965021a51 in Status: SUCCESS [ 1000.804759] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd4746a8-624d-411a-b8a7-b5c965021a51 deletion is rescheduled due to dependency. [ 1000.805040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd4746a8-624d-411a-b8a7-b5c965021a51" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.873318] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.013200] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5e737847-33f1-4d6c-93fe-ab75e211a67a None None] Enqueued Resource ID: 49fd4282-ddd8-45a4-a0e8-a0126947d807 with Priority: HIGHEST for action port [ 1001.013825] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49fd4282-ddd8-45a4-a0e8-a0126947d807 with Priority: HIGHEST for action port [ 1001.015567] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-49fd4282-ddd8-45a4-a0e8-a0126947d807 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.019273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49fd4282-ddd8-45a4-a0e8-a0126947d807" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.019370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49fd4282-ddd8-45a4-a0e8-a0126947d807" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.019674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49fd4282-ddd8-45a4-a0e8-a0126947d807" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.019895] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49fd4282-ddd8-45a4-a0e8-a0126947d807',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.374943] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.522387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49fd4282-ddd8-45a4-a0e8-a0126947d807 [ 1001.522924] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.522924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.522924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.524330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.524330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.524330] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49fd4282-ddd8-45a4-a0e8-a0126947d807 already deleted. [ 1001.524480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49fd4282-ddd8-45a4-a0e8-a0126947d807" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.757028] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 1001.757755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.757755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.757860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.758090] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.759548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.759548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.759548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.759548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.759548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.759548] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.759928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.764346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.764641] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.764806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.764874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.765102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.765190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.765294] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.880223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.880223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.880223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.880433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.880541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.880655] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 1001.910699] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.910954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.911092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.911423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.911673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.920583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 1001.941307] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06b0f72-9b10-4089-a399-981c25e289e8 in Status: SUCCESS [ 1001.941604] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 deletion is rescheduled due to dependency. [ 1001.941787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.268836] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.268836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.269028] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.771703] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.244641] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4cfbf4b2-085a-4168-b926-f48ea5b42d2e None None] Enqueued Resource ID: 39c4c48b-63c9-4307-b0dc-00d7aa221d64 with Priority: HIGHEST for action port [ 1003.244641] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c4c48b-63c9-4307-b0dc-00d7aa221d64 with Priority: HIGHEST for action port [ 1003.244641] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-39c4c48b-63c9-4307-b0dc-00d7aa221d64 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.244641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39c4c48b-63c9-4307-b0dc-00d7aa221d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.244641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39c4c48b-63c9-4307-b0dc-00d7aa221d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.244641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39c4c48b-63c9-4307-b0dc-00d7aa221d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.244641] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39c4c48b-63c9-4307-b0dc-00d7aa221d64',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.275895] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.276052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.276144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.276389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.276537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.276687] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 1003.306590] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.306807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.306850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.310022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.310022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.317667] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 1003.598175] env[69219]: INFO networking_nsxv3.common.synchronization [req-3c62fc3b-8427-42c5-bddc-435db031d541 req-3d218305-e0db-4b10-a19e-4427eafb14c5 tempest-ListServerFiltersTestJSON-897971295 tempest-ListServerFiltersTestJSON-897971295-project-member] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 1003.599770] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 1003.600188] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.600353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.600420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.600626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.600787] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.600887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.600977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.601213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.601353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.601498] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.746143] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39c4c48b-63c9-4307-b0dc-00d7aa221d64 [ 1003.746428] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.746574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.746645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.746872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.746964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.747185] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39c4c48b-63c9-4307-b0dc-00d7aa221d64 already deleted. [ 1003.747185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39c4c48b-63c9-4307-b0dc-00d7aa221d64" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.810874] env[69219]: INFO networking_nsxv3.common.synchronization [req-ca0b72aa-28ea-4968-bb8d-08a99fb764f4 req-4c91d160-6e6b-40bf-8c5f-9927fe22d536 tempest-ServersAdminTestJSON-1946930137 tempest-ServersAdminTestJSON-1946930137-project-member] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 1003.811469] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGHEST for action security_group_members [ 1003.811805] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.811922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.811989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.812411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.812577] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.812688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.812911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.812911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.813031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.813078] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.930219] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 1003.930219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.104365] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.184686] env[69219]: INFO networking_nsxv3.common.synchronization [req-11fe5748-8061-4289-8497-320f979eac40 req-3d3af803-17fb-4f78-8558-34744bd0dc5f tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1004.188128] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1004.188128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.188128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.188128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.188128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.188128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.188128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.188128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.188128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.188128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.188128] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.429243] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.429601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.429714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.429984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.449934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.450284] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.450497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.450572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.450774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.450859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.450951] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be updated. [ 1004.475121] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.475269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.475337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.475540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.475675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.483191] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: IN_PROGRESS for 2s [ 1004.607266] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.695090] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.706512] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.706719] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.706867] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.707123] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.707388] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.707548] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.707664] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.707898] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.708266] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.712023] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.712023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.712023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.712023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.712023] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.712023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.712023] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.726866] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.727041] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.727180] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.727357] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.727676] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-43565075-565a-4042-9fbb-48a332f3d699 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.727841] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.727955] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.728317] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.728454] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43565075-565a-4042-9fbb-48a332f3d699',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.110070] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.110418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.110418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.110641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.110731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.110835] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 1005.138430] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.138581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.138650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.138859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.139000] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.149093] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 1005.204659] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.221145] env[69219]: INFO networking_nsxv3.common.synchronization [req-7ddf11f0-b144-4be4-a982-5d6f058c8b08 req-b9651508-9a93-47ad-bfba-ff4b68902814 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1005.221145] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1005.221145] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.221145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.221145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.221145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.227831] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.227831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.227831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.227831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.227831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.227831] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.237028] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.237028] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.237028] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.237335] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.237409] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.237559] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 43565075-565a-4042-9fbb-48a332f3d699 not found, creating... [ 1005.237824] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.237982] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.238111] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.238323] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.238539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.238824] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.238982] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.239135] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.239343] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.239597] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.239750] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 43565075-565a-4042-9fbb-48a332f3d699 is going to be created. [ 1005.262152] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.262242] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.262360] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.262609] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.262921] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.263884] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.335453] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 1005.335693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.335877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.336126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.336319] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.336465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.336550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.336703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.336787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.336873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.337046] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.337154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.337225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.337331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.337466] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.337549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.337604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.337732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.337802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.337879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.337963] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.359641] env[69219]: INFO networking_nsxv3.common.synchronization [req-6acbe125-a911-4d91-9337-a77e9d9d6ee3 req-b52146a2-53bd-4d31-997f-ce5369bd2a51 tempest-ImagesOneServerNegativeTestJSON-1736267006 tempest-ImagesOneServerNegativeTestJSON-1736267006-project-member] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 1005.360762] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGHEST for action security_group_members [ 1005.360762] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.360762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.360954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.360990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.361404] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.361528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.361528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.361837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.361837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.361965] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.703033] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.703175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.703175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.703407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.703524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.703641] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1005.731336] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.731535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.731610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.731770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.731919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.733086] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.733202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.733270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.733424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.733504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.733674] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.733770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.733828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.733965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.734049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.734133] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be updated. [ 1005.747222] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1005.765044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.765044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.765044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.765044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.765044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.772641] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: IN_PROGRESS for 2s [ 1005.840835] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdacd70-c14b-4dd0-9cba-de8872db32ca: rpc.has_security_group_logging(os_id): False [ 1005.861590] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.861729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.861814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.862012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.862154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.862647] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.862647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.862647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.862647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.862854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.862854] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.863034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.863034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.863159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.863211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.863421] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.863532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.863594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.863734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.863807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.863890] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 1005.865098] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.865206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.865261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.865412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.865491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.865654] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.865764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.865810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.865949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.866033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.866116] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be updated. [ 1005.889742] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.889873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.889951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.890171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.890303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.898737] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: IN_PROGRESS for 2s [ 1005.922234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.922369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.923298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.923298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.923298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.938165] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 1006.290353] env[69219]: INFO networking_nsxv3.common.synchronization [req-11fe5748-8061-4289-8497-320f979eac40 req-e8783fb4-96df-4f5d-b9c5-5d516c69f103 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1006.290353] env[69219]: INFO networking_nsxv3.common.synchronization [req-11fe5748-8061-4289-8497-320f979eac40 req-e8783fb4-96df-4f5d-b9c5-5d516c69f103 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1006.290353] env[69219]: INFO networking_nsxv3.common.synchronization [req-11fe5748-8061-4289-8497-320f979eac40 req-e8783fb4-96df-4f5d-b9c5-5d516c69f103 service nova] Enqueued Resource ID: 43565075-565a-4042-9fbb-48a332f3d699 with Priority: HIGHEST for action port [ 1006.290798] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1006.290798] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1006.290946] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43565075-565a-4042-9fbb-48a332f3d699 with Priority: HIGHEST for action port [ 1006.296543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.296543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.296543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.296543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.296543] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.296543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.296543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.296543] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-43565075-565a-4042-9fbb-48a332f3d699 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.296543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.296543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.296543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.296543] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43565075-565a-4042-9fbb-48a332f3d699',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.493054] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b911077-41e4-4e60-b59f-e672bb56c601 in Status: SUCCESS [ 1006.493242] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 deletion is rescheduled due to dependency. [ 1006.493448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.798148] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.798287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.798482] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43565075-565a-4042-9fbb-48a332f3d699 with status ACTIVE [ 1006.798655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.798763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.798827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.799053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.799139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.799305] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.799416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.799484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.799632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.799708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.799886] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.799993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.800054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.800179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.800251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.800332] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43565075-565a-4042-9fbb-48a332f3d699 is going to be updated. [ 1006.822093] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.822228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.822300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.822541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.822609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.822786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43565075-565a-4042-9fbb-48a332f3d699" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.841993] env[69219]: INFO networking_nsxv3.common.synchronization [req-a7cf455d-2e88-4bf3-acdf-a118d4a7276c req-94c9fa9a-3c84-465f-8b5f-aef9df668d9b tempest-ServersNegativeTestJSON-974271614 tempest-ServersNegativeTestJSON-974271614-project-member] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1006.842404] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1006.842708] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.842826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.842887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.843775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.843851] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.843939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.844015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.844424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.844517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.844615] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.159221] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 1007.159445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.229778] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.230778] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.230778] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.230778] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.231225] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.231225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.231225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.232059] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.232059] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.232059] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.232059] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.232059] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.232297] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.232297] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.232364] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.232583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.252698] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.252917] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.253083] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.253271] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.254362] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.254362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.254362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.254362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.254362] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.350512] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.757059] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.757467] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.757619] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.757914] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.758083] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.758246] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 not found, creating... [ 1007.758695] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.758928] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.759027] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.759316] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.759426] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.759728] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.759890] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.760022] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.760298] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.760498] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.760656] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 is going to be created. [ 1007.762226] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1007.762409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.762567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.762732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.762889] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.762990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.763066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.763209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.763285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.763376] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.781098] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.781857] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.781857] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.781857] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.782049] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.782278] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.783442] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: SUCCESS [ 1007.783597] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 deletion is rescheduled due to dependency. [ 1007.784117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.852792] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.909602] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 in Status: SUCCESS [ 1007.909818] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 deletion is rescheduled due to dependency. [ 1007.910668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.962547] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 1007.962787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.962943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.963185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.963270] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.265955] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.358080] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.358080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.358080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.358080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.358080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.358080] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be updated. [ 1008.381390] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.381525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.381589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.381788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.381925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.393109] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 1008.465756] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.465915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.465979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.466241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.466408] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.466513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.466579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.466723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.466812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.466898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.466982] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.562450] env[69219]: INFO networking_nsxv3.common.synchronization [req-a7cf455d-2e88-4bf3-acdf-a118d4a7276c req-11499f7e-ce64-4643-a96c-21134750ce10 service nova] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_rules [ 1008.562629] env[69219]: INFO networking_nsxv3.common.synchronization [req-a7cf455d-2e88-4bf3-acdf-a118d4a7276c req-11499f7e-ce64-4643-a96c-21134750ce10 service nova] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1008.562767] env[69219]: INFO networking_nsxv3.common.synchronization [req-a7cf455d-2e88-4bf3-acdf-a118d4a7276c req-11499f7e-ce64-4643-a96c-21134750ce10 service nova] Enqueued Resource ID: 35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 with Priority: HIGHEST for action port [ 1008.562986] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_rules [ 1008.563130] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1008.563222] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 with Priority: HIGHEST for action port [ 1008.563755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.563874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.563937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.565178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.565268] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.567635] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.567727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.568952] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.568952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.572630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.572630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.572630] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.768459] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.972511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.972511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.972511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.972511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.972511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.973218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.973654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.973921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.974193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.975218] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.072454] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.075246] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 with status ACTIVE [ 1009.075246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.075246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.075246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.075246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.076289] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8 is going to be updated. [ 1009.095511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.095511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.095511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.095511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.095511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.095511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35e7aac8-4f16-44d3-aca4-1f9de8c8b3f8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.191453] env[69219]: INFO networking_nsxv3.common.synchronization [req-09140075-3713-4c84-87d2-1c61f0f1bf98 req-71c79356-da34-4151-9632-f8f3edcc4a09 tempest-ServersV294TestFqdnHostnames-1201944735 tempest-ServersV294TestFqdnHostnames-1201944735-project-member] Enqueued Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_members [ 1009.192039] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_members [ 1009.192757] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.192757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.192757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.193036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.193036] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.193212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.193212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.193349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.193408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.193495] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.270984] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.271160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.271231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.271470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.271574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.271676] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1009.298464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.298679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.298679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.298897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.299048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.307730] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1009.477774] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdacd70-c14b-4dd0-9cba-de8872db32ca: rpc.has_security_group_logging(os_id): False [ 1009.485195] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.485397] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-504" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.485526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-504" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.485867] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-504" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.486155] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.486324] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.486446] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.486677] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.486828] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.490989] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.491199] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.491326] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.491508] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.491617] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.491701] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.491800] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.495284] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.495402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.499149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.499334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.499428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.499618] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.499716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.499775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.499922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.500014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.500200] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.500292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.500350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.500505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.500602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.501063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.501063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.501063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.501063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.501264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.501264] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 1009.508336] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.508491] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.508631] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.508804] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-504" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.509069] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-f3e9c176-6c6f-435a-baf8-71e16be3a345 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.509232] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.509352] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.509624] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.509768] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3e9c176-6c6f-435a-baf8-71e16be3a345',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.556764] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.557562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.557562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.557562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.557562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.585091] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 1009.695206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.695378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.695453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.695744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.695787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.695977] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.696093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.696159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.696305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.696379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.696465] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfae446e-9362-456c-b5ff-375627350736 already deleted. [ 1009.696545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.012694] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.012957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.013122] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.013402] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.013564] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.013722] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port f3e9c176-6c6f-435a-baf8-71e16be3a345 not found, creating... [ 1010.013991] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.014165] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.014286] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.014504] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.014646] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.014927] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.015187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.015332] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.015548] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.015688] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.015830] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: f3e9c176-6c6f-435a-baf8-71e16be3a345 is going to be created. [ 1010.035434] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.035664] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.035742] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.035979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.036219] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.036437] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.398693] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 1010.398857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.399050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.399266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.399444] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.399561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.400839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.400839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.400839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.400839] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.902037] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.941529] env[69219]: INFO networking_nsxv3.common.synchronization [req-09140075-3713-4c84-87d2-1c61f0f1bf98 req-cc74d306-4e6a-44ee-b4e8-548a733e5eca service nova] Enqueued Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_rules [ 1010.941735] env[69219]: INFO networking_nsxv3.common.synchronization [req-09140075-3713-4c84-87d2-1c61f0f1bf98 req-cc74d306-4e6a-44ee-b4e8-548a733e5eca service nova] Enqueued Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_members [ 1010.941873] env[69219]: INFO networking_nsxv3.common.synchronization [req-09140075-3713-4c84-87d2-1c61f0f1bf98 req-cc74d306-4e6a-44ee-b4e8-548a733e5eca service nova] Enqueued Resource ID: f3e9c176-6c6f-435a-baf8-71e16be3a345 with Priority: HIGHEST for action port [ 1010.942169] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_rules [ 1010.942301] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_members [ 1010.942395] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3e9c176-6c6f-435a-baf8-71e16be3a345 with Priority: HIGHEST for action port [ 1010.942926] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.943940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.943940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.944383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.945034] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.945848] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.945972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.946052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.946516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.946683] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.946794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.946878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.947055] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.949517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.949517] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.949517] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3e9c176-6c6f-435a-baf8-71e16be3a345 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.949517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.949517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.949517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.949517] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3e9c176-6c6f-435a-baf8-71e16be3a345',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.194328] env[69219]: INFO networking_nsxv3.common.synchronization [req-94c53d1d-8518-4320-835a-2a0c0b0ea408 req-367e036a-5495-4152-a8b6-4d0cf98883a0 tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 1011.194914] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 1011.195265] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.195416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.195487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.195707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.195879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.195992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.197756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.198023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.198104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.198173] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.320128] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1011.320394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.320590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.320817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.321038] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.321140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.321204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.321353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.321425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.321513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.321603] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.404715] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.447102] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.447102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.449636] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.450854] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3e9c176-6c6f-435a-baf8-71e16be3a345 with status ACTIVE [ 1011.451198] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.451358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.451456] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.451690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.451797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.452053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.452362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.452362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.453021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.453021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.453219] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.453387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.453529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.453962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.454082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.454189] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3e9c176-6c6f-435a-baf8-71e16be3a345 is going to be updated. [ 1011.477140] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.477140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.477140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.477140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.477140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.477140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3e9c176-6c6f-435a-baf8-71e16be3a345" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.482500] env[69219]: INFO networking_nsxv3.common.synchronization [req-94c53d1d-8518-4320-835a-2a0c0b0ea408 req-5dc2e91d-83fe-4ddd-9338-0affdc97ca6f tempest-ServersTestMultiNic-2108558770 tempest-ServersTestMultiNic-2108558770-project-member] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 1011.482699] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGHEST for action security_group_members [ 1011.483494] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.483779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.601588] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 1011.601808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.706972] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.759865] env[69219]: INFO networking_nsxv3.common.synchronization [req-a3164355-ae21-4255-9bc4-80e8ae9d8d55 req-a60e4b17-49ae-4b53-bfb5-34b72045aa1b tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1011.760513] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1011.760964] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.761175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.761276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.761583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.761778] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.761905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.761987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.762198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.762303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.762410] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.827509] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.827775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.827864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.828147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.828369] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.828480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.828623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.828759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.828879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.828993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.829184] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.830101] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.830101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.830535] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.907392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.907855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.907902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.908167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.908267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.908433] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be updated. [ 1011.934748] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.934884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.934951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.935180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.935324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.943174] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 1011.952130] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.068286] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.068698] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.068862] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.069491] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.069837] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.070091] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.070260] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.070557] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.070775] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.072059] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.072059] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.072059] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.072059] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.072059] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.072059] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.072059] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.098567] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.098741] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1012.098917] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.099135] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.099452] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-f223ef1b-9385-4cfa-a066-f89a086e932a taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.099627] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.099754] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.100085] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.100230] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f223ef1b-9385-4cfa-a066-f89a086e932a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.209349] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.265044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.265332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.265459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.265588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.265676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.265879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.266000] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.266081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.266192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.266261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.266341] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 already deleted. [ 1012.266414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.333756] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605a443b-d883-4950-9fad-dd508996ac8f: rpc.has_security_group_logging(os_id): False [ 1012.354877] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.355062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.355133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.355373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.355488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.355741] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.355850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.355907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.356091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.356172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.356518] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.356518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.356691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.356691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.356829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.356967] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.357093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.357153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.357317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.357405] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.357466] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1012.427851] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.427989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.428058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.428266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.428437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.444165] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1012.453750] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.454062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.454166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.454399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.454501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.454622] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfae446e-9362-456c-b5ff-375627350736 is going to be created. [ 1012.492858] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.493066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.493157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.493301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.493463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.507641] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfae446e-9362-456c-b5ff-375627350736 in Status: UNINITIALIZED for 2s [ 1012.602690] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.602984] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.603136] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.603420] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.603581] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.603741] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port f223ef1b-9385-4cfa-a066-f89a086e932a not found, creating... [ 1012.604020] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.604180] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.604344] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.604512] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.604653] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.605076] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.605171] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.605210] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.605420] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.605557] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.605779] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: f223ef1b-9385-4cfa-a066-f89a086e932a is going to be created. [ 1012.641365] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.641620] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.641770] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.642053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.642339] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.642519] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.711645] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.711850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.711975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.712123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.712271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.712310] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 1012.756344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.756489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.756560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.756802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.756924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.766766] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 1013.321535] env[69219]: INFO networking_nsxv3.common.synchronization [req-a3164355-ae21-4255-9bc4-80e8ae9d8d55 req-e54a5293-35d5-49bc-8592-0a7c514e58fc service nova] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 1013.321822] env[69219]: INFO networking_nsxv3.common.synchronization [req-a3164355-ae21-4255-9bc4-80e8ae9d8d55 req-e54a5293-35d5-49bc-8592-0a7c514e58fc service nova] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1013.321911] env[69219]: INFO networking_nsxv3.common.synchronization [req-a3164355-ae21-4255-9bc4-80e8ae9d8d55 req-e54a5293-35d5-49bc-8592-0a7c514e58fc service nova] Enqueued Resource ID: f223ef1b-9385-4cfa-a066-f89a086e932a with Priority: HIGHEST for action port [ 1013.322447] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 1013.322573] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1013.322667] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f223ef1b-9385-4cfa-a066-f89a086e932a with Priority: HIGHEST for action port [ 1013.323447] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.323525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.323565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.323762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.323836] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.326040] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.326249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.326249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.326345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.326512] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.326615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.326673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.331287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.331287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.331287] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.331287] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f223ef1b-9385-4cfa-a066-f89a086e932a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.331287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.331287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.331287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.331287] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f223ef1b-9385-4cfa-a066-f89a086e932a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.831393] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.832533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.832673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.833062] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f223ef1b-9385-4cfa-a066-f89a086e932a with status ACTIVE [ 1013.833249] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.833378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.833434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.833668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.833746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.833916] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.834018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.834081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.834241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.834318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.834546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.834613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.834659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.834767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.834843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.834926] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f223ef1b-9385-4cfa-a066-f89a086e932a is going to be updated. [ 1013.854772] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.854918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.854986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.855188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.855335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.855514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f223ef1b-9385-4cfa-a066-f89a086e932a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.955544] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.955544] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.955544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.955544] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.333739] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.457026] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1014.457351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.457894] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.458093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.458223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.458410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.458597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.458719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.458785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.458975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.463573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.463764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.463988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.464108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.464170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.464341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.464512] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.464582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.464872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.464872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.464872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.464992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.465051] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.520056] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfae446e-9362-456c-b5ff-375627350736 in Status: SUCCESS [ 1014.520283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.520453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.520693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.520889] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.521017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.521083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.521233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.521316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.521399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.521545] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.783706] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 1014.783706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.783706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.783706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.783706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.783706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.783706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.783706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.783706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.783706] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.839051] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.839051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.839051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.839051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.839051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.839051] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be created. [ 1014.863212] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.863212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.863212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.863212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.863212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.870539] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: UNINITIALIZED for 2s [ 1014.967366] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4620fe61-858f-4c22-8abc-d5f135e99e49: rpc.has_security_group_logging(os_id): False [ 1014.989024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.989024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.989024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.989024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.989024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.989024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.989024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.989462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.990487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.990622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.990830] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.990952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.991047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.991242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.991348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.991622] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.992900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.992997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.993117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.993202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.993305] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be updated. [ 1015.028486] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.053147] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.053639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.053850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.054188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.054503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.070394] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 1015.285568] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.285723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.285770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.286198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.286198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.286480] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.286622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.286706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.286901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.287019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.287171] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be updated. [ 1015.312292] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.312498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.312576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.313947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.313947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.323937] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: IN_PROGRESS for 2s [ 1015.530748] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bfae446e-9362-456c-b5ff-375627350736: rpc.has_security_group_logging(os_id): False [ 1015.552818] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.552818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.552818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.552818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.552818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.553206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.553206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.553206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.553206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.553399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.553505] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfae446e-9362-456c-b5ff-375627350736 is going to be created. [ 1015.648014] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.648210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.648281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.648646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.649108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.659581] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfae446e-9362-456c-b5ff-375627350736 in Status: IN_PROGRESS for 2s [ 1016.515277] env[69219]: INFO networking_nsxv3.common.synchronization [req-5eaf346b-0422-41fa-847e-c337132947ef req-2893be62-57c7-4243-a7a2-fe87836b6571 tempest-MigrationsAdminTest-1548575404 tempest-MigrationsAdminTest-1548575404-project-member] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1016.517091] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1016.517091] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.517886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.518195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.520151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.520151] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.520151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.520151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.520151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.520151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.520151] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.826023] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-689 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.826023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.826023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.826023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.826023] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.826023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.826023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.826023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.826023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.826023] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.826023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.826023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.826023] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.826817] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.826817] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.826817] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.844720] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.844897] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.845030] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.845222] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-689" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.845524] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-4aa8fa61-406e-46e2-a710-85c6e3e105d6 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.845701] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.845815] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.846159] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.846303] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa8fa61-406e-46e2-a710-85c6e3e105d6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.879084] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1016.879335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.879454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.880554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.880554] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.880554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.880554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.880554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.880554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.880554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.880554] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.020793] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.084197] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 1017.084197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.333426] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca in Status: SUCCESS [ 1017.333611] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca deletion is rescheduled due to dependency. [ 1017.333732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.350145] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.350419] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.350638] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.350936] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.351109] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.351270] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 4aa8fa61-406e-46e2-a710-85c6e3e105d6 not found, creating... [ 1017.351715] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.351914] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.352058] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.352286] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.352433] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.352722] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.352913] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.354236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.354588] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.354780] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.355231] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 4aa8fa61-406e-46e2-a710-85c6e3e105d6 is going to be created. [ 1017.375147] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.375147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.375147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.375147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.375147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.375147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.382614] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.524343] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.611257] env[69219]: INFO networking_nsxv3.common.synchronization [req-aa199817-e645-4228-88a2-b8192858f6a1 req-56779550-2a65-4d5e-b186-e73c85067d9c tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1017.611819] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1017.612156] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.612282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.612346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.612535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.612679] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.612878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.612878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.613012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.613083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.613163] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.672857] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfae446e-9362-456c-b5ff-375627350736 in Status: SUCCESS [ 1017.672857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.887954] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fd497c4-079b-43cf-9489-d33299e4d9c7: rpc.has_security_group_logging(os_id): False [ 1017.908588] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.908818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.908818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.909049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.909138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.909522] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.909701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.909774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.909932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.910018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.910143] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be created. [ 1017.979223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.979389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.979485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.979662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.979808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.989582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1018.026200] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.026376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.026424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.026636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.026734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.026852] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be updated. [ 1018.064709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.064918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.064918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.065580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.065580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.077950] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: IN_PROGRESS for 2s [ 1018.115683] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.166057] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c0c4f129-799b-47cb-b18b-af5eb2af64a5 None None] Enqueued Resource ID: a730f51c-0d64-495d-ba67-fc9c7acb255d with Priority: HIGHEST for action port [ 1018.166057] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a730f51c-0d64-495d-ba67-fc9c7acb255d with Priority: HIGHEST for action port [ 1018.166057] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-a730f51c-0d64-495d-ba67-fc9c7acb255d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.166057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a730f51c-0d64-495d-ba67-fc9c7acb255d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.166057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a730f51c-0d64-495d-ba67-fc9c7acb255d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.166057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a730f51c-0d64-495d-ba67-fc9c7acb255d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.166057] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a730f51c-0d64-495d-ba67-fc9c7acb255d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.279684] env[69219]: INFO networking_nsxv3.common.synchronization [req-5eaf346b-0422-41fa-847e-c337132947ef req-c6a5c192-b7b3-410d-9448-79d865292644 service nova] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_rules [ 1018.279684] env[69219]: INFO networking_nsxv3.common.synchronization [req-5eaf346b-0422-41fa-847e-c337132947ef req-c6a5c192-b7b3-410d-9448-79d865292644 service nova] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1018.279684] env[69219]: INFO networking_nsxv3.common.synchronization [req-5eaf346b-0422-41fa-847e-c337132947ef req-c6a5c192-b7b3-410d-9448-79d865292644 service nova] Enqueued Resource ID: 4aa8fa61-406e-46e2-a710-85c6e3e105d6 with Priority: HIGHEST for action port [ 1018.279684] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_rules [ 1018.279684] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1018.279684] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa8fa61-406e-46e2-a710-85c6e3e105d6 with Priority: HIGHEST for action port [ 1018.279684] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.279684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.279684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.279684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.279684] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.280231] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.280286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.280511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aa8fa61-406e-46e2-a710-85c6e3e105d6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.280626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.280673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.280823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.280897] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa8fa61-406e-46e2-a710-85c6e3e105d6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.618149] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.670104] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a730f51c-0d64-495d-ba67-fc9c7acb255d [ 1018.670398] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.670576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.670669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.670903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.671309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.671309] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a730f51c-0d64-495d-ba67-fc9c7acb255d already deleted. [ 1018.671309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a730f51c-0d64-495d-ba67-fc9c7acb255d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.785594] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.785731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.786100] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4aa8fa61-406e-46e2-a710-85c6e3e105d6 with status ACTIVE [ 1018.786100] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.786236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.786282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.786569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.786569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.786687] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.786788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.786835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.787021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.787102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.787285] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.787383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.787442] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.787580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.787666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.787752] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4aa8fa61-406e-46e2-a710-85c6e3e105d6 is going to be updated. [ 1018.807571] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.808946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.809046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.809607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.809607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.809607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aa8fa61-406e-46e2-a710-85c6e3e105d6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.122205] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.122591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.122591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.122847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.122984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.123142] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1019.148436] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.148680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.148680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.148886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.149040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.156968] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1020.000283] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1020.000760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.084336] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: SUCCESS [ 1020.084336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.084336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.084553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.084736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.084851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.084914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.085095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.085169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.085311] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.226329] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4201d5ce-79c5-4367-809b-4ae7fc6046a5 None None] Enqueued Resource ID: 3d12e473-04c6-481d-812a-5bf067422926 with Priority: HIGHEST for action port [ 1020.226617] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d12e473-04c6-481d-812a-5bf067422926 with Priority: HIGHEST for action port [ 1020.227244] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d12e473-04c6-481d-812a-5bf067422926 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.227888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d12e473-04c6-481d-812a-5bf067422926" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.227970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d12e473-04c6-481d-812a-5bf067422926" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.229555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d12e473-04c6-481d-812a-5bf067422926" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.229555] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d12e473-04c6-481d-812a-5bf067422926',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.590690] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.605532] env[69219]: INFO networking_nsxv3.common.synchronization [req-33c9aed4-91ae-4146-9446-f4de2bfd543a req-65463035-6ccc-48ba-8155-b5f57ebea99b tempest-ServersNegativeTestJSON-974271614 tempest-ServersNegativeTestJSON-974271614-project-member] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1020.605712] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1020.606512] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.606638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.606705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.606902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.607086] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.607187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.607244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.607392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.607473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.607564] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.732050] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d12e473-04c6-481d-812a-5bf067422926 [ 1020.733635] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.733635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.733635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.733635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.733635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.733635] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d12e473-04c6-481d-812a-5bf067422926 already deleted. [ 1020.733635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d12e473-04c6-481d-812a-5bf067422926" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.094941] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.109708] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.173108] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1021.173108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.524455] env[69219]: INFO networking_nsxv3.common.synchronization [req-bcf53492-eb7f-4dca-a251-135d4fd2d232 req-3015d85d-afaa-428b-9e9d-875a4808f2a6 tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_members [ 1021.524948] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGHEST for action security_group_members [ 1021.525287] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.525412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.525479] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.525671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.525832] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.525938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.526014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.527096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.527206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.527306] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.599844] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.600073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.600152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.600388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.600606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.600752] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be updated. [ 1021.613745] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.627871] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.628023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.628129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.628293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.628463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.635910] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: IN_PROGRESS for 2s [ 1022.030334] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.030529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.030596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.030812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.052638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.052638] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.052638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.052638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.052888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.052888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.052888] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 is going to be updated. [ 1022.077218] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.077369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.077430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.077634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.077795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.085587] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 in Status: IN_PROGRESS for 2s [ 1022.116204] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.116366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.116471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.116659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.116754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.116855] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be updated. [ 1022.141737] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.141737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.141737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.141737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.142099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.152099] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 1023.644999] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: SUCCESS [ 1023.645414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.645414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.645577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.645768] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.645884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.645947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.646117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.646198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.646284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.646373] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.094991] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 in Status: SUCCESS [ 1024.095250] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 deletion is rescheduled due to dependency. [ 1024.095395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.148405] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.148587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.148671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.148936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.149232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.149295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.149349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.149520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.149622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.149731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.149920] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.150091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.150127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.150302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.150572] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.150738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.150855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.151581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.151791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.152040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.153598] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.168073] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 1024.168073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.658849] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee58207b-f6f5-4d2a-b0d7-fb2dc440c630: rpc.has_security_group_logging(os_id): False [ 1024.676100] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.676696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.676696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.676696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.693149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.693413] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.693576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.693625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.695024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.695024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.695024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.695727] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be updated. [ 1024.750273] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.750273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.750273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.750273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.750273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.761262] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: IN_PROGRESS for 2s [ 1025.038347] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8bd5f2a3-0570-4149-872b-b1f09db3811d tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1025.038420] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1025.038693] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.041265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.041395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.041642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.043148] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.143579] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8d8a3b4b-58c4-47ec-872f-79a5afbfa9ef tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1025.144503] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1025.144503] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.144604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.564424] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.564601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.564662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.564865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.564958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.565091] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 already deleted. [ 1025.565190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.565349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.565502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.565595] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.087076] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.087076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.087076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.087076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.087076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.087076] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 already deleted. [ 1026.087076] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.777036] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: SUCCESS [ 1026.777036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.835927] env[69219]: INFO networking_nsxv3.common.synchronization [req-827e7008-ff5f-433f-a71f-536f2e848eb5 req-78158eea-040e-4d0a-92be-a42a4e9c30de tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1029.836353] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1029.836618] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.837067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.837067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.837067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.837318] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.837438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.837530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.837743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.837842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.838161] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.341517] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.341517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.341517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.341517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.363680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.363680] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.363680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.363680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.363680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.363680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.363680] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1030.387361] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.387504] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.387555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.387758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.387894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.396874] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1032.423227] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1032.423549] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee deletion is rescheduled due to dependency. [ 1032.423549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.624147] env[69219]: INFO networking_nsxv3.common.synchronization [req-c12ff49e-1335-4677-9627-fd1373aebf50 req-04307ecc-4d29-4646-8e1f-6d568e3a7910 tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1033.624147] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1033.624147] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.624147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.624147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.628437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.628643] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.629367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.629367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.629367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.629367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.629367] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.131804] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.131978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.132067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.132286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.132381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.132896] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.133095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.133174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.133343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.133423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.133515] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 1034.162071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.162213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.162262] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.162474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.162612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.171126] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 1034.287973] env[69219]: INFO networking_nsxv3.common.synchronization [None req-47beb8bf-c275-4d53-9c25-72ced7be23ee None None] Enqueued Resource ID: b725f29e-a2c2-4b4f-a75e-8f998fb07c7c with Priority: HIGHEST for action port [ 1034.288541] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b725f29e-a2c2-4b4f-a75e-8f998fb07c7c with Priority: HIGHEST for action port [ 1034.289223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b725f29e-a2c2-4b4f-a75e-8f998fb07c7c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.289223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b725f29e-a2c2-4b4f-a75e-8f998fb07c7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.289223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b725f29e-a2c2-4b4f-a75e-8f998fb07c7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.289458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b725f29e-a2c2-4b4f-a75e-8f998fb07c7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.289458] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b725f29e-a2c2-4b4f-a75e-8f998fb07c7c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.791927] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b725f29e-a2c2-4b4f-a75e-8f998fb07c7c [ 1034.792212] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.792349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.792419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.792635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.792835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.792835] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b725f29e-a2c2-4b4f-a75e-8f998fb07c7c already deleted. [ 1034.792949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b725f29e-a2c2-4b4f-a75e-8f998fb07c7c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.369271] env[69219]: INFO networking_nsxv3.common.synchronization [None req-38261417-d93d-4c7a-aa65-8e7771741781 tempest-ServersTestManualDisk-73161595 tempest-ServersTestManualDisk-73161595-project-member] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_rules [ 1035.369976] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_rules [ 1035.372100] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.372303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.372432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.372800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.372943] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.447237] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f89f1b32-95e7-4bf7-8612-cfef5ca5211b tempest-ServersTestManualDisk-73161595 tempest-ServersTestManualDisk-73161595-project-member] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_rules [ 1035.447237] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_rules [ 1035.447561] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.447710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.900317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.900317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.900317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.900317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.900317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.900317] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 already deleted. [ 1035.900317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.900317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.900317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.900317] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.182783] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 1036.183008] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d deletion is rescheduled due to dependency. [ 1036.183154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.283614] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4cdbc8f3-1a78-4129-8c6f-885236396235 None None] Enqueued Resource ID: 27f202a3-a8bc-4cdc-a5d3-757105fadb67 with Priority: HIGHEST for action port [ 1036.285031] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f202a3-a8bc-4cdc-a5d3-757105fadb67 with Priority: HIGHEST for action port [ 1036.285031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f202a3-a8bc-4cdc-a5d3-757105fadb67 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.285031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f202a3-a8bc-4cdc-a5d3-757105fadb67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.285031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f202a3-a8bc-4cdc-a5d3-757105fadb67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.285031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f202a3-a8bc-4cdc-a5d3-757105fadb67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.290026] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f202a3-a8bc-4cdc-a5d3-757105fadb67',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.313473] env[69219]: INFO networking_nsxv3.common.synchronization [req-714178cd-7cc7-4213-9f3f-84652ccae0fe req-87f42628-b51d-481a-a8ad-e489670f9f16 tempest-ServerMetadataNegativeTestJSON-2044785651 tempest-ServerMetadataNegativeTestJSON-2044785651-project-member] Enqueued Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_members [ 1036.314362] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_members [ 1036.314477] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.314601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.314667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.314919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.315502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.315622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.315684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.315856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.315942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.316086] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.421876] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.421876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.421876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.421876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.421876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.421876] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 already deleted. [ 1036.421876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.618423] env[69219]: INFO networking_nsxv3.common.synchronization [None req-dca3d6d0-645f-4dc5-98ef-32ee989d6b5f None None] Enqueued Resource ID: d09c42f0-d98b-450b-a2af-fd86a6b3784c with Priority: HIGHEST for action port [ 1036.619296] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d09c42f0-d98b-450b-a2af-fd86a6b3784c with Priority: HIGHEST for action port [ 1036.620646] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d09c42f0-d98b-450b-a2af-fd86a6b3784c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.622354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d09c42f0-d98b-450b-a2af-fd86a6b3784c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.622429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d09c42f0-d98b-450b-a2af-fd86a6b3784c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.622694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d09c42f0-d98b-450b-a2af-fd86a6b3784c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.622775] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d09c42f0-d98b-450b-a2af-fd86a6b3784c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.791081] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27f202a3-a8bc-4cdc-a5d3-757105fadb67 [ 1036.792366] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.792366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.792366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.792366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.792366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.792366] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27f202a3-a8bc-4cdc-a5d3-757105fadb67 already deleted. [ 1036.792366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f202a3-a8bc-4cdc-a5d3-757105fadb67" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.818618] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.818785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.818856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.819119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.819285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.819423] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.819524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.819587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.819759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.819835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.819873] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 already deleted. [ 1036.819951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.862498] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.862708] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-582" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.862841] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-582" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.863198] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-582" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.863472] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.863640] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.863765] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.864212] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.864377] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.864605] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.864800] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.864857] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.864942] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.865070] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.865179] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.865313] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.884603] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.884603] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1036.885090] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.885390] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-582" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.885924] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-47ada5d6-df91-4263-a386-3fa145ae4b97 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.886151] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.886350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.886704] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.886892] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47ada5d6-df91-4263-a386-3fa145ae4b97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.126471] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d09c42f0-d98b-450b-a2af-fd86a6b3784c [ 1037.127024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.127024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.127024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.127024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.127274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.127274] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d09c42f0-d98b-450b-a2af-fd86a6b3784c already deleted. [ 1037.127274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d09c42f0-d98b-450b-a2af-fd86a6b3784c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.385991] env[69219]: INFO networking_nsxv3.common.synchronization [None req-84098d7b-c86d-44f0-86ae-c7c399cffbd4 tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1037.386580] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1037.386895] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.387032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.387110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.387635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.387728] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.389443] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.389647] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.389781] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.390055] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.390218] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.390377] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 47ada5d6-df91-4263-a386-3fa145ae4b97 not found, creating... [ 1037.390674] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.390890] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.391096] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.391345] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.392696] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.392696] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.392696] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.392696] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.392696] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.392696] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.392696] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 47ada5d6-df91-4263-a386-3fa145ae4b97 is going to be created. [ 1037.415274] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.415274] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.415475] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.416031] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.416209] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.416514] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.461501] env[69219]: INFO networking_nsxv3.common.synchronization [None req-fdb0920d-48ba-4158-964f-350652c94b35 tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1037.462277] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1037.463018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.463191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.917354] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.920255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.920255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.920255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.920255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.920255] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 already deleted. [ 1037.920255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.920255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.920255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.920255] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.166598] env[69219]: INFO networking_nsxv3.common.synchronization [req-714178cd-7cc7-4213-9f3f-84652ccae0fe req-d7ea3bce-a179-4401-a61c-d214e09a7ea5 service nova] Enqueued Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_rules [ 1038.166886] env[69219]: INFO networking_nsxv3.common.synchronization [req-714178cd-7cc7-4213-9f3f-84652ccae0fe req-d7ea3bce-a179-4401-a61c-d214e09a7ea5 service nova] Enqueued Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_members [ 1038.166886] env[69219]: INFO networking_nsxv3.common.synchronization [req-714178cd-7cc7-4213-9f3f-84652ccae0fe req-d7ea3bce-a179-4401-a61c-d214e09a7ea5 service nova] Enqueued Resource ID: 47ada5d6-df91-4263-a386-3fa145ae4b97 with Priority: HIGHEST for action port [ 1038.167339] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_rules [ 1038.167480] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_members [ 1038.167580] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ada5d6-df91-4263-a386-3fa145ae4b97 with Priority: HIGHEST for action port [ 1038.167923] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.168018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.169608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.169608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.169608] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.170832] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.171127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.171319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.171607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.173018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.173018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.173018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.173018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.173018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.173018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.177011] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-47ada5d6-df91-4263-a386-3fa145ae4b97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.177011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.177011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.177011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.177011] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47ada5d6-df91-4263-a386-3fa145ae4b97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.442166] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.442786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.442786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.442786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.442786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.442983] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 already deleted. [ 1038.442983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.676521] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.677635] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.677752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.677944] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47ada5d6-df91-4263-a386-3fa145ae4b97 with status ACTIVE [ 1038.678132] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.678240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.678319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.678521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.678616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.678838] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.678943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.678998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.679177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.679268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.679450] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.679550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.683601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.683601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.683601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.683601] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47ada5d6-df91-4263-a386-3fa145ae4b97 is going to be updated. [ 1038.701606] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.701606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.701606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.701606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.701606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.701606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47ada5d6-df91-4263-a386-3fa145ae4b97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.963420] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2f09bc56-3ee6-44ce-a0b2-0b5942d5fbb0 None None] Enqueued Resource ID: ea3fdb23-3dbc-47bd-8486-579a31fe3353 with Priority: HIGHEST for action port [ 1038.963696] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3fdb23-3dbc-47bd-8486-579a31fe3353 with Priority: HIGHEST for action port [ 1038.964294] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea3fdb23-3dbc-47bd-8486-579a31fe3353 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.964411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea3fdb23-3dbc-47bd-8486-579a31fe3353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.964477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea3fdb23-3dbc-47bd-8486-579a31fe3353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.964816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea3fdb23-3dbc-47bd-8486-579a31fe3353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.964816] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3fdb23-3dbc-47bd-8486-579a31fe3353',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.183610] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.466806] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea3fdb23-3dbc-47bd-8486-579a31fe3353 [ 1039.466906] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.467099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.467203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.467444] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.467568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.467701] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea3fdb23-3dbc-47bd-8486-579a31fe3353 already deleted. [ 1039.467821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea3fdb23-3dbc-47bd-8486-579a31fe3353" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.686512] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.686678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.686754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.686980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.687096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.687185] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 is going to be created. [ 1039.708382] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.708643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.708753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.709017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.709243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.718087] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 in Status: UNINITIALIZED for 2s [ 1041.355993] env[69219]: INFO networking_nsxv3.common.synchronization [req-7f946e3a-9caf-4489-ad62-0b9d360836e5 req-3de5ae4c-2dc8-49f9-85db-4ff49711b754 tempest-ListServerFiltersTestJSON-897971295 tempest-ListServerFiltersTestJSON-897971295-project-member] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 1041.357424] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGHEST for action security_group_members [ 1041.357933] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.360054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.360054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.360054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.360054] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.360054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.360054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.360054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.360054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.360054] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.728414] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 in Status: SUCCESS [ 1041.728642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.728806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.729031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.729229] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.729350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.729411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.729560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.729640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.729726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.729817] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.862246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.862246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.862246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.862539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.862539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.862812] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.862812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.862945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.863673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.863673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.863673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be updated. [ 1041.887863] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.887994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.888188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.888350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.888869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.897570] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: IN_PROGRESS for 2s [ 1042.234419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.234632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.234675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.234870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.235156] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.235241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.235241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.235390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.235595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.235595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.235739] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.235836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.235896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.236050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.236194] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.236285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.236346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.236522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.236561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.236647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.236706] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.739035] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49f615d4-07b5-4c31-a7c9-afa72b7059c0: rpc.has_security_group_logging(os_id): False [ 1042.756930] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.757134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.757207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.757581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.757691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.757954] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.758086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.758146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.758415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.758415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.758694] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.758694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.758777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.758884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.758985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.759376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.759478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.759542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.759716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.759905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.759905] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 is going to be created. [ 1042.812301] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.812476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.812532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.812732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.813037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.825872] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 in Status: IN_PROGRESS for 2s [ 1043.439628] env[69219]: INFO networking_nsxv3.common.synchronization [None req-b19325aa-7554-4d55-a06c-26beda392dc8 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_rules [ 1043.439628] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_rules [ 1043.439628] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.439628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.439628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.439628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.439628] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.535919] env[69219]: INFO networking_nsxv3.common.synchronization [None req-9495b66d-f770-4ecf-9a5a-297b5ff43434 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_rules [ 1043.536511] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_rules [ 1043.537209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.537209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.906194] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 in Status: SUCCESS [ 1043.906409] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 deletion is rescheduled due to dependency. [ 1043.906483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.958336] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.958516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.958516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.958773] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.958870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.958970] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 already deleted. [ 1043.959074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.959213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.959587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.959587] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.479712] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.479984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.480218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.480372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.480536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.480717] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 already deleted. [ 1044.480818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.840532] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 in Status: SUCCESS [ 1044.840783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.327144] env[69219]: INFO networking_nsxv3.common.synchronization [req-2183709e-f870-48a0-80ca-e056d08aa954 req-f189a8e8-2dae-462c-b730-801f933dc552 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1048.327144] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1048.327144] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.327144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.327144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.329701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.329701] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.329845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.329845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.331225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.331225] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.331225] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.832347] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.833228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.833228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.833228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.833228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.833228] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.833228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.833228] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.833666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.833666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.833666] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1048.860119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.860778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.860778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.860778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.860778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.868168] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1050.568149] env[69219]: INFO networking_nsxv3.common.synchronization [req-19cd6cd8-25d0-44d1-8355-13a3c1fb2439 req-6f644443-9123-43bc-8811-bcf3d7c2ef71 tempest-ServerMetadataNegativeTestJSON-2044785651 tempest-ServerMetadataNegativeTestJSON-2044785651-project-member] Enqueued Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_members [ 1050.568149] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGHEST for action security_group_members [ 1050.568149] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.568149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.568149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.568149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.568149] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.568634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.569723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.569723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.569723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.569723] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.878315] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1050.878881] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 1050.878881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.071624] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.071772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.071840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.072080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.072173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.072376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.072475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.072536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.072692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.072766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.072848] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 is going to be updated. [ 1051.097794] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.098469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.098608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.098894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.099135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.107571] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 in Status: IN_PROGRESS for 2s [ 1053.121034] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 in Status: SUCCESS [ 1053.121034] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 deletion is rescheduled due to dependency. [ 1053.121034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.440367] env[69219]: INFO networking_nsxv3.common.synchronization [req-68d71cbd-30c7-4c92-a425-342ebb8b1bfb req-ee1a42f7-9fe9-4d73-8a63-d06c2e146cc6 tempest-ServerMetadataTestJSON-1857539793 tempest-ServerMetadataTestJSON-1857539793-project-member] Enqueued Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_members [ 1054.440916] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_members [ 1054.441238] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.441360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.441509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.441678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.441846] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.441956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.442094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.442265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.442352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.442443] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.719654] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.719868] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-193" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.722587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-193" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.722587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-193" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.722587] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.722587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.722587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.722587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.722587] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.722587] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.722587] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.722587] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.722587] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.722587] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.722587] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.722587] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.766262] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.766501] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.766619] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.766684] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-193" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.766985] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-54f4b258-19f3-455b-b577-94a48057664b taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.767187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.767304] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.767618] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.767757] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f4b258-19f3-455b-b577-94a48057664b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.945459] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.945541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.946210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.946210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.946210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.946210] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.946486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.946486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.946486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.946628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.946628] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d already deleted. [ 1054.946781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.270536] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.270841] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.270987] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.271362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.271456] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.271591] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 54f4b258-19f3-455b-b577-94a48057664b not found, creating... [ 1055.271909] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.272092] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.272238] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.272439] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.272585] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.272868] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.273524] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.273753] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.273981] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.274144] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.274502] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 54f4b258-19f3-455b-b577-94a48057664b is going to be created. [ 1055.295217] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.295378] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.295511] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.295780] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.296072] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.296399] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.441587] env[69219]: INFO networking_nsxv3.common.synchronization [None req-eaaf1ed6-d34b-4977-b242-53ac04890775 None None] Enqueued Resource ID: d8713179-6355-4b71-9faf-70fceaa8dfcf with Priority: HIGHEST for action port [ 1055.442350] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8713179-6355-4b71-9faf-70fceaa8dfcf with Priority: HIGHEST for action port [ 1055.442697] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8713179-6355-4b71-9faf-70fceaa8dfcf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.442824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8713179-6355-4b71-9faf-70fceaa8dfcf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.442893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8713179-6355-4b71-9faf-70fceaa8dfcf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.443263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8713179-6355-4b71-9faf-70fceaa8dfcf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.443345] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8713179-6355-4b71-9faf-70fceaa8dfcf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.946296] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8713179-6355-4b71-9faf-70fceaa8dfcf [ 1055.946410] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.946500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.946663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.946750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.946842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.946941] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8713179-6355-4b71-9faf-70fceaa8dfcf already deleted. [ 1055.947031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8713179-6355-4b71-9faf-70fceaa8dfcf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.955369] env[69219]: INFO networking_nsxv3.common.synchronization [req-68d71cbd-30c7-4c92-a425-342ebb8b1bfb req-0361693c-0dc3-4464-9ad6-c75fa781dcc8 service nova] Enqueued Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_rules [ 1055.955648] env[69219]: INFO networking_nsxv3.common.synchronization [req-68d71cbd-30c7-4c92-a425-342ebb8b1bfb req-0361693c-0dc3-4464-9ad6-c75fa781dcc8 service nova] Enqueued Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_members [ 1055.955721] env[69219]: INFO networking_nsxv3.common.synchronization [req-68d71cbd-30c7-4c92-a425-342ebb8b1bfb req-0361693c-0dc3-4464-9ad6-c75fa781dcc8 service nova] Enqueued Resource ID: 54f4b258-19f3-455b-b577-94a48057664b with Priority: HIGHEST for action port [ 1055.955913] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_rules [ 1055.956058] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_members [ 1055.956159] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f4b258-19f3-455b-b577-94a48057664b with Priority: HIGHEST for action port [ 1055.957907] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.957907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.957907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.957907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.957907] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.959279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.959279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.959380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.964556] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.964556] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.964556] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f4b258-19f3-455b-b577-94a48057664b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.964556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.965751] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f4b258-19f3-455b-b577-94a48057664b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.467695] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.467978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.468041] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.468933] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54f4b258-19f3-455b-b577-94a48057664b with status ACTIVE [ 1056.469116] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.469230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.469294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.469488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.469578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.469743] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.469837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.469896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.470054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.470131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.470307] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.470396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.470454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.470588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.470661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.470761] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54f4b258-19f3-455b-b577-94a48057664b is going to be updated. [ 1056.495141] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.495289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.495358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.495560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.495706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.495852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f4b258-19f3-455b-b577-94a48057664b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.976282] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.480201] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.480522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.480522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.480638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.480735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.480857] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d is going to be created. [ 1057.505130] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.505130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.505130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.505130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.505408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.513404] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d in Status: UNINITIALIZED for 2s [ 1057.724418] env[69219]: INFO networking_nsxv3.common.synchronization [None req-750656fa-c8ff-477e-87d9-04fdbe11421c None None] Enqueued Resource ID: 08d973b2-4a13-4af5-9bf1-3ccb601d1579 with Priority: HIGHEST for action port [ 1057.724996] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08d973b2-4a13-4af5-9bf1-3ccb601d1579 with Priority: HIGHEST for action port [ 1057.725387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-08d973b2-4a13-4af5-9bf1-3ccb601d1579 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.725517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08d973b2-4a13-4af5-9bf1-3ccb601d1579" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.725585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08d973b2-4a13-4af5-9bf1-3ccb601d1579" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.725859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08d973b2-4a13-4af5-9bf1-3ccb601d1579" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.726095] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08d973b2-4a13-4af5-9bf1-3ccb601d1579',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.228161] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08d973b2-4a13-4af5-9bf1-3ccb601d1579 [ 1058.228381] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.228519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.228588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.228814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.228905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.229054] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08d973b2-4a13-4af5-9bf1-3ccb601d1579 already deleted. [ 1058.229172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08d973b2-4a13-4af5-9bf1-3ccb601d1579" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.522889] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d in Status: UNINITIALIZED for 4s [ 1060.609213] env[69219]: INFO networking_nsxv3.common.synchronization [req-89cec7e2-c1e5-446d-88d6-2bdcc31cebb9 req-de14a7f6-23be-4f4d-8356-6dc90b4e9205 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1060.610101] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1060.610980] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.611277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.611453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.611792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.612095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.613028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.613028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.613028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.613028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.613028] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.889579] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.889705] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.889798] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.890235] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.890541] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.890794] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.890966] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.891270] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.891481] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.891740] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.891890] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.892072] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.892249] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.892416] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.892594] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.892766] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.911454] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.911671] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.911835] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.912107] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.912489] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c125d26e-8975-4bf2-a7d7-defe892947a9 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.912713] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.912908] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.913316] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.913500] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c125d26e-8975-4bf2-a7d7-defe892947a9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.115556] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.115726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.115801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.116044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.116141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.116343] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.116446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.116509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.116658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.116804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.117605] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 already deleted. [ 1061.117605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.416315] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.416564] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.416697] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.416995] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.417189] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.417351] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c125d26e-8975-4bf2-a7d7-defe892947a9 not found, creating... [ 1061.417639] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.417819] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.417954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.418223] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.418373] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.418678] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.418896] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.419052] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.419272] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.419417] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.419559] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c125d26e-8975-4bf2-a7d7-defe892947a9 is going to be created. [ 1061.441701] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.441976] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.442186] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.442520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.442830] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.443146] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.532937] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d in Status: SUCCESS [ 1061.533226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.533387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.533642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.534104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.534104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.534104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.534252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.534252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.534360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.534422] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.037720] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.037996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.037996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.038193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.038379] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.038481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.038581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.038696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.038781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.038866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.039027] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.039116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.039173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.039314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.039452] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.039679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.039743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.039885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.039983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.040084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.040172] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.139258] env[69219]: INFO networking_nsxv3.common.synchronization [req-89cec7e2-c1e5-446d-88d6-2bdcc31cebb9 req-9a35bcf7-2fae-43e3-8b39-ed7fc425f76f service nova] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1062.139452] env[69219]: INFO networking_nsxv3.common.synchronization [req-89cec7e2-c1e5-446d-88d6-2bdcc31cebb9 req-9a35bcf7-2fae-43e3-8b39-ed7fc425f76f service nova] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1062.139596] env[69219]: INFO networking_nsxv3.common.synchronization [req-89cec7e2-c1e5-446d-88d6-2bdcc31cebb9 req-9a35bcf7-2fae-43e3-8b39-ed7fc425f76f service nova] Enqueued Resource ID: c125d26e-8975-4bf2-a7d7-defe892947a9 with Priority: HIGHEST for action port [ 1062.139835] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1062.139965] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1062.140694] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c125d26e-8975-4bf2-a7d7-defe892947a9 with Priority: HIGHEST for action port [ 1062.140694] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.140988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.140988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.141105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.141181] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.142035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.142159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.143109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.143109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.143109] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.143109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.143109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.143109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.143109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.143109] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.143802] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c125d26e-8975-4bf2-a7d7-defe892947a9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.145042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.145042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.145042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.145042] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c125d26e-8975-4bf2-a7d7-defe892947a9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.542844] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d: rpc.has_security_group_logging(os_id): False [ 1062.561342] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.561490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.561543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.561753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.561891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.562130] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.562316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.562316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.562452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.562525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.562726] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.562834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.562939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.563117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.563194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.563373] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.563452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.563519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.563899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.563899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.563899] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d is going to be created. [ 1062.622146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.622146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.622146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.622146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.622146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.641417] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d in Status: IN_PROGRESS for 2s [ 1062.647091] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.647091] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.647091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.647213] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c125d26e-8975-4bf2-a7d7-defe892947a9 with status ACTIVE [ 1062.647621] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.647621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.647621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.647789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.647789] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.647978] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.648133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.648133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.648212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.648348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.648509] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.648602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.648660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.648807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.648891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.648976] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c125d26e-8975-4bf2-a7d7-defe892947a9 is going to be updated. [ 1062.669078] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.669261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.669365] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.669593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.669735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.669896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c125d26e-8975-4bf2-a7d7-defe892947a9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.150890] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.658209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.658371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.658445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.658675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.658827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.658890] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be created. [ 1063.687143] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.687143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.687143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.687143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.687143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.694865] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: UNINITIALIZED for 2s [ 1063.870291] env[69219]: INFO networking_nsxv3.common.synchronization [req-ceda98b7-cace-43ad-9b08-d25a7468fcfc req-b6e9fa97-065b-45f5-a47b-2ed6f6154e45 tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 1063.870917] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 1063.871533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.871533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.871533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.871642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.871818] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.872042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.872160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.872294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.872385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.872483] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.376480] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.659240] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d in Status: SUCCESS [ 1064.659565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.880390] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.383442] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.383704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.383704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.383920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.384029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.384137] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be updated. [ 1065.410640] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.410813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.410885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.411117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.411268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.422019] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: IN_PROGRESS for 2s [ 1065.705082] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: SUCCESS [ 1065.705082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.705082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.705082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.705437] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.705437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.705437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.706060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.706060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.706060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.706060] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.208570] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.687102] env[69219]: INFO networking_nsxv3.common.synchronization [req-d92bb2ab-b389-4a6a-a13a-6ef5f4e563bb req-9040cfb0-80a2-41ba-867b-dbfc3bf92b74 tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1066.687647] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1066.687953] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.688089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.688155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.688354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.688510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.688608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.688672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.688844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.688933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.689490] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.712618] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb30b358-da7b-4abc-ac4d-7b6b8baeed61: rpc.has_security_group_logging(os_id): False [ 1066.730374] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.730571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.730663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.730992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.731138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.731439] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.731567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.731654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.731848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.731931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.732227] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be created. [ 1066.788171] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.788171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.788171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.788171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.788171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.798611] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: IN_PROGRESS for 2s [ 1067.032239] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.032453] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.032581] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.032854] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.033133] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.033326] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.033468] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.033823] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.034067] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.034342] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.034558] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.034759] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.034936] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.035103] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1067.035255] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.035420] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.054781] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.055018] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1067.055305] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.055546] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-752" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.055964] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-8897b051-3af4-4c88-91c3-07af60508498 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.056234] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.056369] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.057198] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.057198] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8897b051-3af4-4c88-91c3-07af60508498',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.188764] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1067.188925] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:2 started [ 1067.191481] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.191614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.191687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.191903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.192036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.192193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.192292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.192353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.192571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.192652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.192740] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 1067.217388] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.217616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.217678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.217895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.218047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.226340] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 1067.429511] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 1067.429511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.561056] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.561056] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.561056] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.561584] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.563237] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.563560] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 8897b051-3af4-4c88-91c3-07af60508498 not found, creating... [ 1067.563994] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.564478] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.565061] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.565061] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.565365] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.566665] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.566665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.566665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.566665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.566665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.566665] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 8897b051-3af4-4c88-91c3-07af60508498 is going to be created. [ 1067.586100] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.586247] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.586594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.586633] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.587020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.587162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.321373] env[69219]: INFO networking_nsxv3.common.synchronization [req-d92bb2ab-b389-4a6a-a13a-6ef5f4e563bb req-aa9eff9f-4486-4b5f-8a90-90241d7da511 service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 1068.321373] env[69219]: INFO networking_nsxv3.common.synchronization [req-d92bb2ab-b389-4a6a-a13a-6ef5f4e563bb req-aa9eff9f-4486-4b5f-8a90-90241d7da511 service nova] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1068.321622] env[69219]: INFO networking_nsxv3.common.synchronization [req-d92bb2ab-b389-4a6a-a13a-6ef5f4e563bb req-aa9eff9f-4486-4b5f-8a90-90241d7da511 service nova] Enqueued Resource ID: 8897b051-3af4-4c88-91c3-07af60508498 with Priority: HIGHEST for action port [ 1068.321698] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_rules [ 1068.321829] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1068.321926] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8897b051-3af4-4c88-91c3-07af60508498 with Priority: HIGHEST for action port [ 1068.322544] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.322689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.325797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.325797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.325797] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.326772] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.326875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.327077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-8897b051-3af4-4c88-91c3-07af60508498 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.327249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.327311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.327531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.327659] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8897b051-3af4-4c88-91c3-07af60508498',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.809490] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: SUCCESS [ 1068.810500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.835104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.835104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.835104] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8897b051-3af4-4c88-91c3-07af60508498 with status ACTIVE [ 1068.835104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.835104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.835104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.835375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.835375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.836355] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.836355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.836355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.836355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.836355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.836355] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.836355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.836355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.836749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.836749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.836749] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8897b051-3af4-4c88-91c3-07af60508498 is going to be updated. [ 1068.857735] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.857735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.857735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.857935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.857995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.858142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8897b051-3af4-4c88-91c3-07af60508498" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.237045] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 1069.237045] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d deletion is rescheduled due to dependency. [ 1069.237045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.237045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.237045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.237265] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.237265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.237347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.237502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.237588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.237689] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.744752] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.249117] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.640642] env[69219]: INFO networking_nsxv3.common.synchronization [req-44f74177-0a45-435f-9b43-2458e46882ed req-11522b82-8a20-4d5d-9664-999b0f2bf2c7 tempest-ServerMetadataTestJSON-1857539793 tempest-ServerMetadataTestJSON-1857539793-project-member] Enqueued Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_members [ 1070.641200] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGHEST for action security_group_members [ 1070.641510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.641636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.641697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.641944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.642129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.642252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.642312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.642445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.642551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.642643] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.756460] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.756804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.756804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.756904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.756997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.757109] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 1070.782582] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.782730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.782799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.783107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.783278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.792734] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 1071.147153] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.147153] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.147153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.147153] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d is going to be updated. [ 1071.175167] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.175404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.176565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.176841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.178308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.185528] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d in Status: IN_PROGRESS for 2s [ 1071.211883] env[69219]: INFO networking_nsxv3.common.synchronization [req-82966e26-8928-4d0e-96c4-312f093f951e req-5d2bddd8-949a-4134-b660-1c86feecdf7c tempest-ServersTestManualDisk-73161595 tempest-ServersTestManualDisk-73161595-project-member] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_members [ 1071.212423] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_members [ 1071.212721] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.212846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.212909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.213187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.213316] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.213415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.213473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.213616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.213697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.213783] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.531528] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.531729] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.531905] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.532330] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.532629] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.532793] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.532915] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.533167] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.533311] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.533796] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.533796] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.533796] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.533935] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.533935] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1071.534071] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.534215] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.553575] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.553734] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1071.553877] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.554062] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-922" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.554348] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-f020bb69-b2a6-48b3-9854-58e97311c827 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.554515] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.554638] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.554924] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.555082] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f020bb69-b2a6-48b3-9854-58e97311c827',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.716137] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.716949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.716949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.716949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.716949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.716949] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.717146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.717146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.717206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.717264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.717383] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 already deleted. [ 1071.717467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.057662] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.057935] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.057935] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.058265] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.058630] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.058630] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port f020bb69-b2a6-48b3-9854-58e97311c827 not found, creating... [ 1072.058830] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.059018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.059148] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.059382] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.059527] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.059809] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.059967] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.060102] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.060309] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.060448] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.060587] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: f020bb69-b2a6-48b3-9854-58e97311c827 is going to be created. [ 1072.094401] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.094401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.094401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.094401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.094401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.094703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.782602] env[69219]: INFO networking_nsxv3.common.synchronization [req-82966e26-8928-4d0e-96c4-312f093f951e req-7c9ee756-9d9f-4313-a21b-5be0f0c8f75d service nova] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_rules [ 1072.782826] env[69219]: INFO networking_nsxv3.common.synchronization [req-82966e26-8928-4d0e-96c4-312f093f951e req-7c9ee756-9d9f-4313-a21b-5be0f0c8f75d service nova] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_members [ 1072.783014] env[69219]: INFO networking_nsxv3.common.synchronization [req-82966e26-8928-4d0e-96c4-312f093f951e req-7c9ee756-9d9f-4313-a21b-5be0f0c8f75d service nova] Enqueued Resource ID: f020bb69-b2a6-48b3-9854-58e97311c827 with Priority: HIGHEST for action port [ 1072.783578] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_rules [ 1072.783733] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_members [ 1072.783841] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f020bb69-b2a6-48b3-9854-58e97311c827 with Priority: HIGHEST for action port [ 1072.784749] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.784977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.785129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.785466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.785613] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.786927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.787139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.787266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.787565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.787847] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.788900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.788900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.788900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.788900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.788900] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.790214] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-f020bb69-b2a6-48b3-9854-58e97311c827 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.790214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.790214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.790607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.790607] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f020bb69-b2a6-48b3-9854-58e97311c827',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.803272] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 1072.803954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.804835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.804975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.805402] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.805508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.805607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.805874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.806025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.806144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.806237] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.195178] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d in Status: SUCCESS [ 1073.195423] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d deletion is rescheduled due to dependency. [ 1073.195457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.292789] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.292935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.293145] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.294084] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f020bb69-b2a6-48b3-9854-58e97311c827 with status ACTIVE [ 1073.294696] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.294696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.294696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.294696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.294846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.295094] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.295230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.295337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.295574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.295822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.296061] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.296402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.296518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.296757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.296884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.297069] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f020bb69-b2a6-48b3-9854-58e97311c827 is going to be updated. [ 1073.309504] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.309746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.309852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.310179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.310376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.310506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.310995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.310995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.310995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.310995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.311202] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.311202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.311310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.311419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.311551] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.311640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.311700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.311835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.311910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.311991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.312093] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.321138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.321308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.321352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.321543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.321674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.321835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f020bb69-b2a6-48b3-9854-58e97311c827" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.540646] env[69219]: INFO networking_nsxv3.common.synchronization [req-ef387416-db06-462b-bcfa-97a6df13da65 req-62dfc4f8-10b6-4f4d-bf98-3aaf67dce5d3 tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1073.541235] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1073.541532] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.541642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.541706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.543394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.543559] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.543663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.543721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.543894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.543974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.544074] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.800181] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.818066] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df327ac5-73cd-478c-b19b-3849894e070d: rpc.has_security_group_logging(os_id): False [ 1073.836537] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.836977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.837182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.837470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.837654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.837966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.838216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.838360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.838591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.838750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.839047] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.839270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.839412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.839624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.841645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.841645] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.841645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.841645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.841645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.841645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.841645] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 1073.907015] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.907015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.907015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.907015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.907015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.925088] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 1074.051034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.051034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.051034] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 already deleted. [ 1074.051034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.228048] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.228048] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.228415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.228559] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.228966] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.229259] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.229388] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.229630] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.229785] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.230324] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.230498] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.230621] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.230843] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.231423] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.231567] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.231834] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.252910] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.253131] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1074.253285] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.253495] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.253847] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9bc79ed1-f427-48b7-9976-7b029eefce81 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.254043] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.254191] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.254526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.254670] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc79ed1-f427-48b7-9976-7b029eefce81',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.301952] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.302171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.302298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.302552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.302674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.302811] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 is going to be created. [ 1074.329149] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.329319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.329429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.329615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.329801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.338980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: UNINITIALIZED for 2s [ 1074.758072] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.758431] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.758682] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.759126] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.759317] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.759488] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9bc79ed1-f427-48b7-9976-7b029eefce81 not found, creating... [ 1074.759856] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.760421] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.760421] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.760530] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.760689] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.761143] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.761574] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.761727] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.761996] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.762156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.762326] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 is going to be created. [ 1074.781779] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.781864] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.782107] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.782524] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.782886] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.783321] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.475690] env[69219]: INFO networking_nsxv3.common.synchronization [req-ef387416-db06-462b-bcfa-97a6df13da65 req-6b5b2e77-7f98-4286-9d60-412e3ea2d805 service nova] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1075.475938] env[69219]: INFO networking_nsxv3.common.synchronization [req-ef387416-db06-462b-bcfa-97a6df13da65 req-6b5b2e77-7f98-4286-9d60-412e3ea2d805 service nova] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1075.476115] env[69219]: INFO networking_nsxv3.common.synchronization [req-ef387416-db06-462b-bcfa-97a6df13da65 req-6b5b2e77-7f98-4286-9d60-412e3ea2d805 service nova] Enqueued Resource ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 with Priority: HIGHEST for action port [ 1075.476693] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1075.476829] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1075.476930] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 with Priority: HIGHEST for action port [ 1075.477338] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.477676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.477676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.477849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.477929] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.478771] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.479031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.479134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.479335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.479503] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.479652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.479758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.479943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.480056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.480157] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.481155] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bc79ed1-f427-48b7-9976-7b029eefce81 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.481319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.481426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.481637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.481718] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc79ed1-f427-48b7-9976-7b029eefce81',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.939903] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 1075.940163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.983897] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.984079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.986922] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.986922] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bc79ed1-f427-48b7-9976-7b029eefce81 with status ACTIVE [ 1075.986922] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.986922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.986922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.986922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.987334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.987334] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.987334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.987432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.987571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.987616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.988057] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.988057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.988057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.988208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.988208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.988271] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 is going to be updated. [ 1076.007727] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.007875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.008430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.008430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.008430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.008564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.352427] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: SUCCESS [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.352427] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.352427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.352427] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.490963] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.854537] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.994177] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.994333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.994410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.994639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.994738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.994846] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 is going to be created. [ 1077.016053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.016229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.016296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.016533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.016663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.024766] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: UNINITIALIZED for 2s [ 1077.357364] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ca12f68-e96e-40a5-86d0-c5aa6f465be8: rpc.has_security_group_logging(os_id): False [ 1077.376493] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.376925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.376925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.377175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.377349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.377693] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.377855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.377966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.378389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.378389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.378491] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 is going to be created. [ 1077.451453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.451761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.451917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.452267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.452934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.473686] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: IN_PROGRESS for 2s [ 1078.570613] env[69219]: INFO networking_nsxv3.common.synchronization [req-95ca942c-0f46-45c6-955a-506f4660e08b req-08c6514b-973e-41c1-811e-3e0923ca9469 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1078.571867] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1078.571867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.571867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.571867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.574955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.574955] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.574955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.574955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.574955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.574955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.574955] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.035360] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: SUCCESS [ 1079.035647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.035813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.036061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.036286] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.036433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.036501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.036674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.036756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.036842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.036943] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.076834] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.076949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.077034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.077326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.077427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.077691] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.077799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.077860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.078023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.078101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.078183] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 1079.106409] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.106650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.106733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.106897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.107085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.115810] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 1079.485562] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: SUCCESS [ 1079.486328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.540047] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.042921] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8: rpc.has_security_group_logging(os_id): False [ 1080.061779] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.061973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.062047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.062289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.062390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.062663] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.062781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.062847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.063033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.063117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.063215] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 is going to be created. [ 1080.118251] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.118483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.118483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.118666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.118915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.130012] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: IN_PROGRESS for 2s [ 1080.497188] env[69219]: INFO networking_nsxv3.common.synchronization [req-e98b1d31-cfd1-4fd4-8143-f1634c85f85a req-b9ea0af2-3989-4c47-9f95-5c21d74ebb47 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_members [ 1080.497713] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_members [ 1080.500636] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.500636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.500636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.500636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.500636] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.500636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.500636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.500636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.500636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.500636] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.795120] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.795328] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.795555] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.795731] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.795996] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.796177] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.796299] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.796519] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.796751] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.796884] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.797076] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.797133] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.797238] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.797354] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.797464] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.797601] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.814990] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.815174] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.815322] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.815508] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.815823] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.815999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.816139] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.816466] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.816612] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.003434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.003650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.003771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.004030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.004264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.004780] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.004780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.004780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.004950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.005070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.005187] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 already deleted. [ 1081.005316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.127350] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 1081.127811] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 1081.127811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.318650] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.318982] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.319229] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.319532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.319792] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.320022] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 not found, creating... [ 1081.320350] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.320540] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.320711] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.320994] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.321281] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.321649] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.321930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.322124] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.322403] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.322594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.322778] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 is going to be created. [ 1081.342148] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.342482] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.342700] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.343073] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.343387] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.343703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.143356] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: SUCCESS [ 1082.143861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.288552] env[69219]: INFO networking_nsxv3.common.synchronization [req-e98b1d31-cfd1-4fd4-8143-f1634c85f85a req-13a5fe91-857a-4b5e-bbaf-95ad13af5117 service nova] Enqueued Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_rules [ 1082.288724] env[69219]: INFO networking_nsxv3.common.synchronization [req-e98b1d31-cfd1-4fd4-8143-f1634c85f85a req-13a5fe91-857a-4b5e-bbaf-95ad13af5117 service nova] Enqueued Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_members [ 1082.288868] env[69219]: INFO networking_nsxv3.common.synchronization [req-e98b1d31-cfd1-4fd4-8143-f1634c85f85a req-13a5fe91-857a-4b5e-bbaf-95ad13af5117 service nova] Enqueued Resource ID: 2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 with Priority: HIGHEST for action port [ 1082.289397] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_rules [ 1082.289535] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_members [ 1082.289632] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 with Priority: HIGHEST for action port [ 1082.289906] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.290037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.290104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.290302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.290383] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.291219] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.291361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.291436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.291565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.291727] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.291925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.291925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.292041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.292098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.292194] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.292901] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.292996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.293106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.293224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.293313] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.798483] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.798483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.798483] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.799068] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 with status ACTIVE [ 1082.799245] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.799353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.802022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.802022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.802022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.802022] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366 is going to be updated. [ 1082.820582] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.820729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.820767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.821083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.821193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.821312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c94feb2-b1d0-43c2-a9ef-f4ec37e3c366" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.303919] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.808588] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.808765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.808839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.809156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.809255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.809369] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 is going to be created. [ 1083.832721] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.832902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.833008] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.833287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.833484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.842491] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 in Status: UNINITIALIZED for 2s [ 1085.074326] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c503e3a-c26b-4f81-8f9d-0c95f223bb78 req-fcb49e28-3e69-4988-a6d5-5ae7bbae6a1a tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1085.075243] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1085.075243] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.075392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.075429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.079045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.079045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.079045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.079045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.079045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.079045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.079045] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.451045] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.451045] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.451208] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.451532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.451813] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.452640] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.453449] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.453449] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.453449] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.453622] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.453622] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.453721] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.453818] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.453927] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1085.454045] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.454180] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.479126] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.479126] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1085.479126] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.479126] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.479126] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.479126] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.479126] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.479126] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.481364] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.581025] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.852559] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 in Status: SUCCESS [ 1085.852775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.853337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.853553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.853761] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.853877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.853940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.854352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.854352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.854352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.854352] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.984493] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.984782] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.985184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.985285] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.985474] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.985661] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be not found, creating... [ 1085.986079] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.986320] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.986526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.986851] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.987100] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.987548] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.987777] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.987957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.988280] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.988504] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.988721] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be is going to be created. [ 1086.008668] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.008985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.009138] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.009453] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.009699] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.009949] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.081947] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.355990] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.584444] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.584663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.584769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.585077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.585212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.585355] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1086.613648] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.613916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.614047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.614356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.614568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.622941] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1086.728856] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c503e3a-c26b-4f81-8f9d-0c95f223bb78 req-a3390422-6e48-4901-bf4e-a0a55f630b89 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1086.729059] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c503e3a-c26b-4f81-8f9d-0c95f223bb78 req-a3390422-6e48-4901-bf4e-a0a55f630b89 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1086.729212] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c503e3a-c26b-4f81-8f9d-0c95f223bb78 req-a3390422-6e48-4901-bf4e-a0a55f630b89 service nova] Enqueued Resource ID: c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be with Priority: HIGHEST for action port [ 1086.729441] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1086.729566] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1086.732571] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be with Priority: HIGHEST for action port [ 1086.733862] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.733862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.733862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.734069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.734069] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.734997] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.735137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.735306] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.735417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.735467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.735626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.735703] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.858050] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43: rpc.has_security_group_logging(os_id): False [ 1086.874955] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.875137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.875212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.875460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.875556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.875796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.875895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.875960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.876168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.876249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.876338] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 is going to be created. [ 1086.928736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.928971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.929070] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.929379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.929554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.939705] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 in Status: IN_PROGRESS for 2s [ 1087.240341] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be with status ACTIVE [ 1087.240592] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.240701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.240769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.241024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.241135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.241321] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.241464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.241494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.241633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.241734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.241885] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.241998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.242090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.242222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.242304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.242387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be is going to be updated. [ 1087.247663] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.247663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.278710] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.281029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.281029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.281029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.281029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.281029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7e165b8-9b82-4e1c-8ad4-3e6c5803d6be" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.430124] env[69219]: INFO networking_nsxv3.common.synchronization [req-cf5d035d-f24a-4f53-a869-2205bde9dc1a req-de06f8f9-48e2-431f-8372-2b8a3b75c18b tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1087.430124] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1087.430124] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.430124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.430124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.430124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.430124] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.430124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.430800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.431119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.431322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.431715] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.727913] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-70 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.728141] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.728259] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.728542] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.728810] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.729009] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.729147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.729401] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.729563] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.729818] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.729960] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.730135] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.730258] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.730373] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1087.730508] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.730686] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.749648] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.749648] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1087.749648] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.750546] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.750624] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-57f7cc1c-d580-40cb-8440-1910cde2b559 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.751388] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.751388] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.751388] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.751551] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f7cc1c-d580-40cb-8440-1910cde2b559',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.934874] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.935042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.935172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.935360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.935477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.935601] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.935674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.935717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.935874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.935953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.936236] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1087.962437] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.962578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.962626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.962829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.962970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.973053] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1088.122818] env[69219]: INFO networking_nsxv3.common.synchronization [req-bad56b74-3871-44d3-a50e-cd140e251a33 req-35b288a0-55d4-47a7-bf4b-d7adfeccab7d tempest-ImagesTestJSON-239574999 tempest-ImagesTestJSON-239574999-project-member] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1088.123862] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGHEST for action security_group_members [ 1088.123862] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.123994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.123994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.124493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.124493] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.124493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.124493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.124664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.125034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.125034] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.256552] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.256930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.256930] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.257255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.257455] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.257678] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 57f7cc1c-d580-40cb-8440-1910cde2b559 not found, creating... [ 1088.258107] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.258396] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.258601] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.258904] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.259071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.259394] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.259555] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.259676] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.259899] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.260053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.260200] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 57f7cc1c-d580-40cb-8440-1910cde2b559 is going to be created. [ 1088.279544] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.279710] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.279842] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.280193] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.280461] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.280628] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.626852] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.627025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.627102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.627305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.627398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.627579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.627676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.627737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.627885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.627961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.628056] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be updated. [ 1088.632743] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1088.632802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.632937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.633181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.633307] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.633410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.633475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.633653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.633734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.633826] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.668446] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.668618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.668678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.668901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.669066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.678625] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: IN_PROGRESS for 2s [ 1088.952546] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 in Status: SUCCESS [ 1088.952546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.979992] env[69219]: INFO networking_nsxv3.common.synchronization [req-cf5d035d-f24a-4f53-a869-2205bde9dc1a req-0954f219-dd24-4f24-a929-78c81fab1655 service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 1088.980201] env[69219]: INFO networking_nsxv3.common.synchronization [req-cf5d035d-f24a-4f53-a869-2205bde9dc1a req-0954f219-dd24-4f24-a929-78c81fab1655 service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1088.980410] env[69219]: INFO networking_nsxv3.common.synchronization [req-cf5d035d-f24a-4f53-a869-2205bde9dc1a req-0954f219-dd24-4f24-a929-78c81fab1655 service nova] Enqueued Resource ID: 57f7cc1c-d580-40cb-8440-1910cde2b559 with Priority: HIGHEST for action port [ 1088.980569] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 1088.980695] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1088.980791] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f7cc1c-d580-40cb-8440-1910cde2b559 with Priority: HIGHEST for action port [ 1088.983654] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.983654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.983654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.983654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.983838] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.984612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.984705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.985558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-57f7cc1c-d580-40cb-8440-1910cde2b559 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.985558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.985558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.985558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.985558] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f7cc1c-d580-40cb-8440-1910cde2b559',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.138028] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.487037] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.487344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.489599] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57f7cc1c-d580-40cb-8440-1910cde2b559 with status ACTIVE [ 1089.489836] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.490040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.490142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.490438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.490609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.490875] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.491100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.491204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.491382] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.491485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.491665] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.491790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.491886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.492037] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.492170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.492310] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57f7cc1c-d580-40cb-8440-1910cde2b559 is going to be updated. [ 1089.516840] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.516981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.516981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.517214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.517352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.517607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57f7cc1c-d580-40cb-8440-1910cde2b559" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.643107] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.860793] env[69219]: INFO networking_nsxv3.common.synchronization [req-956b0a7d-c647-40c1-afb0-8f070e16cd05 req-6c8355b0-4e56-43a7-bc50-e04363de920b tempest-InstanceActionsV221TestJSON-2085827730 tempest-InstanceActionsV221TestJSON-2085827730-project-member] Enqueued Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_members [ 1089.861381] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_members [ 1089.861702] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.861826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.861893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.864291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.864470] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.864694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.864694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.864807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.864875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.864971] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.983225] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1089.983550] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 1089.983683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.983848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.984088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.984286] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.984441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.984513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.984690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.984774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.984872] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.145194] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.145316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.145316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.145501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.145598] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.145696] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1090.157921] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-233 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.158123] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-233" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.158253] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-233" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.158584] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-233" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.158865] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.159120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.159253] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.159477] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.159628] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.159846] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.159964] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.160106] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.160222] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.160336] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.160445] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.160580] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.179640] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.179859] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.180077] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.180352] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-233" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.180726] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b43acf8d-6357-4ab6-8613-965773b6dba4 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.180987] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.181177] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.181541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.181725] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43acf8d-6357-4ab6-8613-965773b6dba4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.184206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.184340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.184435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.184621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.184792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.193397] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1090.366791] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.367053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.367113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.367337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.367438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.367646] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.367743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.367805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.367954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.368044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.368128] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 already deleted. [ 1090.368207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.487395] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.684617] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.684900] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.685103] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.685428] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.685637] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.685807] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b43acf8d-6357-4ab6-8613-965773b6dba4 not found, creating... [ 1090.686086] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.686307] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.686458] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.686712] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.686886] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.687193] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.687362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.687482] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.687693] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.687830] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.687971] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b43acf8d-6357-4ab6-8613-965773b6dba4 is going to be created. [ 1090.697973] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df327ac5-73cd-478c-b19b-3849894e070d in Status: SUCCESS [ 1090.698181] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df327ac5-73cd-478c-b19b-3849894e070d deletion is rescheduled due to dependency. [ 1090.698293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.707554] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.707741] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.707873] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.708272] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.708508] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.708741] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.991658] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.492590] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.492983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.492983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.493061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.493139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.493250] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1091.518257] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.518414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.518595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.518686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.518831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.528113] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1091.531370] env[69219]: INFO networking_nsxv3.common.synchronization [req-956b0a7d-c647-40c1-afb0-8f070e16cd05 req-2af39fec-e957-4ec8-8d2b-41039affaea2 service nova] Enqueued Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_rules [ 1091.531541] env[69219]: INFO networking_nsxv3.common.synchronization [req-956b0a7d-c647-40c1-afb0-8f070e16cd05 req-2af39fec-e957-4ec8-8d2b-41039affaea2 service nova] Enqueued Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_members [ 1091.531681] env[69219]: INFO networking_nsxv3.common.synchronization [req-956b0a7d-c647-40c1-afb0-8f070e16cd05 req-2af39fec-e957-4ec8-8d2b-41039affaea2 service nova] Enqueued Resource ID: b43acf8d-6357-4ab6-8613-965773b6dba4 with Priority: HIGHEST for action port [ 1091.531902] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_rules [ 1091.532041] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_members [ 1091.532143] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43acf8d-6357-4ab6-8613-965773b6dba4 with Priority: HIGHEST for action port [ 1091.532668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.532797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.532883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.535271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.535719] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.536516] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.536600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.536643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.537077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.537077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.537181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.537211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.537388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.537455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.537549] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.539034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b43acf8d-6357-4ab6-8613-965773b6dba4 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.539034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.539034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.539221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.539943] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b43acf8d-6357-4ab6-8613-965773b6dba4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.041174] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.041675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.044054] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.044980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b43acf8d-6357-4ab6-8613-965773b6dba4 with status ACTIVE [ 1092.045238] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.045321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.045376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.045567] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.045655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.045826] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.045922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.045985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.046149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.046224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.046401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.050021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.050021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.050021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.050021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.050021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b43acf8d-6357-4ab6-8613-965773b6dba4 is going to be updated. [ 1092.067577] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.067706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.067754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.067968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.068116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.068294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b43acf8d-6357-4ab6-8613-965773b6dba4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.203258] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1092.203556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.203757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.203994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.204216] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.204337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.204403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.204563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.204630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.204721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.204844] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.549706] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.707657] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.707798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.707876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.708128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.708311] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.708421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.708482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.708654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.708758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.708852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.709012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.709129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.709188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.709348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.709500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.709607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.709667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.709823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.709899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.710016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.710113] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.758458] env[69219]: INFO networking_nsxv3.common.synchronization [req-1b04cff7-9cc0-4c54-a93d-dca6e60c4c71 req-1f5e52f5-92f5-4317-9407-82178994b594 tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1092.761255] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1092.761255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.761255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.761255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.761255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.761255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.761255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.761255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.761255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.761255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.761255] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.051904] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.052223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.052293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.052514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.052637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.052768] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 is going to be created. [ 1093.077664] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.078036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.078374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.078449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.078647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.088235] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: UNINITIALIZED for 2s [ 1093.108995] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.109236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.109381] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.109724] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.110016] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.110260] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.110389] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.110618] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.110810] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.111155] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.111333] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.111482] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.111634] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.111741] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.111888] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.112051] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.133047] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.133047] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.133047] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.133047] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.133291] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-61bbdf30-6dfa-4394-a088-d9ba104694fe taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.133416] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.133541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.133876] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.134037] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61bbdf30-6dfa-4394-a088-d9ba104694fe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.212938] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605a443b-d883-4950-9fad-dd508996ac8f: rpc.has_security_group_logging(os_id): False [ 1093.231053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.231362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.231362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.231498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.231589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.232049] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.232049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.232049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.232204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.232204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.232486] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.232486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.232558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.232661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.232724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.232894] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.232985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.233046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.233185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.233257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.233358] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1093.264023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.264023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.264023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.264206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.264206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.264346] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.264440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.264501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.264642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.264714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.264793] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1093.288054] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.288769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.288769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.288769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.288769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.297105] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.297279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.297313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.297492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.297632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.299747] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1093.309866] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1093.537126] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 4s [ 1093.636526] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.636921] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.636921] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.637362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.637566] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.637764] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 61bbdf30-6dfa-4394-a088-d9ba104694fe not found, creating... [ 1093.638082] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.638299] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.638454] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.638772] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.639127] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.639728] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.640009] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.640166] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.640408] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.640583] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.640739] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 61bbdf30-6dfa-4394-a088-d9ba104694fe is going to be created. [ 1093.662859] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.663253] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.663253] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.663623] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.663956] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.664350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.365448] env[69219]: INFO networking_nsxv3.common.synchronization [req-1b04cff7-9cc0-4c54-a93d-dca6e60c4c71 req-77107d81-cb35-426e-a62c-7ec352e167a0 service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 1094.365635] env[69219]: INFO networking_nsxv3.common.synchronization [req-1b04cff7-9cc0-4c54-a93d-dca6e60c4c71 req-77107d81-cb35-426e-a62c-7ec352e167a0 service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1094.365776] env[69219]: INFO networking_nsxv3.common.synchronization [req-1b04cff7-9cc0-4c54-a93d-dca6e60c4c71 req-77107d81-cb35-426e-a62c-7ec352e167a0 service nova] Enqueued Resource ID: 61bbdf30-6dfa-4394-a088-d9ba104694fe with Priority: HIGHEST for action port [ 1094.366017] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 1094.366154] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1094.366253] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61bbdf30-6dfa-4394-a088-d9ba104694fe with Priority: HIGHEST for action port [ 1094.366813] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.366911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.366984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.367191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.367273] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.372063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.372219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.372447] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-61bbdf30-6dfa-4394-a088-d9ba104694fe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.372554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.373478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.373478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.373478] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61bbdf30-6dfa-4394-a088-d9ba104694fe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.877928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.877928] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61bbdf30-6dfa-4394-a088-d9ba104694fe with status ACTIVE [ 1094.877928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.877928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.877928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.877928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.878846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.878846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.878846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.878846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.878846] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61bbdf30-6dfa-4394-a088-d9ba104694fe is going to be updated. [ 1094.925399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.925545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.925616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.925822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.925961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.926155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61bbdf30-6dfa-4394-a088-d9ba104694fe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.100175] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: SUCCESS [ 1095.100502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.100700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.100925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.101220] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.101612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.101612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.101612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.101738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.101738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.101820] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.308758] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1095.308928] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee deletion is rescheduled due to dependency. [ 1095.309062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.310073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.310289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.310476] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.310590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.310657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.310811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.310894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.311038] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.322575] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1095.322776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.547884] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1095.548198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.548535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.548646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.548875] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.549078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.549143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.550640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.550640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.550640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.550640] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.604532] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.604734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.604813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.605042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.605214] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.605324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.605389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.605539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.605635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.605745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.605896] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.605991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.606073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.606215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.606457] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.606561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.606561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.606723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.606775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.606819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.606905] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.813502] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.053923] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.054403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.054403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.054403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.054550] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.054625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.054674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.054795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.054885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.054978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.055152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.055245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.055306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.055449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.055587] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.055678] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.055732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.055894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.055941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.056022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.056116] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.108807] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39e3a8ce-a00d-4a24-8049-ab1615d53479: rpc.has_security_group_logging(os_id): False [ 1096.127070] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.127279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.127279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.127535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.127627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.127842] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.128021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.128097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.128264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.128369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.128623] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.128768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.128861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.129513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.129625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.129839] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.129948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.130017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.130156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.130266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.130438] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 is going to be created. [ 1096.144206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.144400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.144465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.144693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.144806] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.197289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.197489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.197536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.197719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.198097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.210468] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: IN_PROGRESS for 2s [ 1096.316577] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.558362] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 1096.576925] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.577140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.577217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.577390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.577479] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.577675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.577772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.577836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.577989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.578080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.578295] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.578397] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.578453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.578606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.578694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.578903] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.579035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.579629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.579791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.579891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.579985] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1096.642077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.642077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.642246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.642394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.642550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.649344] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.654989] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1096.819825] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.820552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.820698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.820922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.821089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.821244] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1096.847534] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.847669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.847736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.847936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.848086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.855730] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1097.023935] env[69219]: INFO networking_nsxv3.common.synchronization [req-afc06347-196e-4d8a-a88e-bec9ded74802 req-26cfe271-5726-41b5-8ec5-ecec0adb79d1 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1097.024639] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1097.025034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.025176] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.025290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.025484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.026053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.026053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.026053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.026053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.026269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.026269] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.154756] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.528081] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.657307] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1097.657491] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1097.905706] env[69219]: INFO networking_nsxv3.common.synchronization [req-b79368be-06cb-4c38-b511-553044a845c2 req-62845d3b-d418-465e-8f57-c52fd612163c tempest-ServerRescueNegativeTestJSON-1044877489 tempest-ServerRescueNegativeTestJSON-1044877489-project-member] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 1097.905706] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGHEST for action security_group_members [ 1097.905706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.905706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.906233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.906689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.907048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.907283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.907435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.907682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.907900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.908395] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.030890] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.222444] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: SUCCESS [ 1098.222747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.412256] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.412417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.415016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.415016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.431884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.432248] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.432389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.432483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.432665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.432760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.432859] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be updated. [ 1098.459221] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.459221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.459221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.459221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.459640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.467995] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: IN_PROGRESS for 2s [ 1098.532735] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.532898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.533027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.537166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.538279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.538279] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1098.546585] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.546679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.546725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.547175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.565363] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1098.566481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.568022] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1098.570469] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.570627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.570674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.570848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.571074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.581680] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1098.617102] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.617407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.617556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.617959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.632275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.633302] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1098.634899] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1098.635307] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1098.671047] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1098.671354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.693970] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.694162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.694256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.694521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.696265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.696462] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1098.784820] env[69219]: INFO networking_nsxv3.common.synchronization [req-52ddc645-b364-4d39-b764-72b947f075aa req-aa687cca-9f4d-4a32-9330-992b97cb7982 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1098.788125] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.788316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.788496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.788633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.789364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.789597] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1098.790955] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1098.791418] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.791538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.791699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.791942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.792185] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.792331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.792413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.792636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.792746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.792853] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.864254] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.864532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.864532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.864690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.864949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.865254] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1098.865369] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'bc9fb959-a076-420f-a95e-66822d85fa97', '21d8fe10-76ad-439c-96a8-ed7e1f50f5c2', '39e3a8ce-a00d-4a24-8049-ab1615d53479', '6ca12f68-e96e-40a5-86d0-c5aa6f465be8', '4620fe61-858f-4c22-8abc-d5f135e99e49', '03b383a8-62e8-454b-9d3c-ac3de2f9ba05', '7b8eea57-ce57-4940-9c1a-cd39d18803e2', '0b911077-41e4-4e60-b59f-e672bb56c601', 'd4dd29e2-bd83-4aa6-8057-859cad475a65', '1bbfcc96-5e86-4201-bca0-faab328daf1d', '7320ab62-aefe-4739-a54e-e995c8c00fd4', 'cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8', '9c5354b9-81f9-4e22-bc81-6b10e24e0c2c', '1de8e111-6e0d-48d0-816d-62134145ea0f', '825c0c18-33c1-4cb4-8480-e8d82499bbf3', '66dbd3fd-dcc5-433c-8ce2-c27a2f44d005', 'c5538c90-15d8-4803-8aa4-ad7aa2b015b1', '0e07acd6-602d-48e1-bdfd-e4378ff72832', '6e92a878-87ba-416d-b225-777db5147611', 'e223c622-11b3-472e-bc32-fa212373c375', 'eb30b358-da7b-4abc-ac4d-7b6b8baeed61', 'ec5e6bce-48d8-4a26-8add-53a08d2b2afe', '2f8662e1-7633-4a32-9aae-91c642b75dd8', 'bcba48ed-3f96-4cef-8edf-50ba05bacea8', 'ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43', 'c06b0f72-9b10-4089-a399-981c25e289e8', '3afd8a02-3b29-4be8-aae2-a4f15df4f234', '9153ebdf-4f47-4818-bdd9-2172ee701c16', 'ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d', 'd5e5bd65-43e8-43dd-ba51-515caef2f24d', 'df327ac5-73cd-478c-b19b-3849894e070d', '04ba1205-02a7-4968-99ca-25d19305f8e9', '49f615d4-07b5-4c31-a7c9-afa72b7059c0', 'bfae446e-9362-456c-b5ff-375627350736', '398e7926-33dc-450f-9584-34ddbd0ed03a', '0687614d-5fbe-486f-942e-47e8dcdc82e2', '7fdacd70-c14b-4dd0-9cba-de8872db32ca', 'ba38a24c-584a-4fc2-8fc4-91929e372e75', 'ee58207b-f6f5-4d2a-b0d7-fb2dc440c630', '39c47700-2196-4adc-afd5-b72e818055ee', '55b28f2a-86c9-4b72-a2dc-7c308af8d9e3', 'd679379b-ec68-4cf7-8ccd-4f2d4d8b12dd', '50a3720b-a5ee-456e-b60f-4ae4d9b5fe98', '9fd497c4-079b-43cf-9489-d33299e4d9c7', '605a443b-d883-4950-9fad-dd508996ac8f', '1e06ed06-d558-4f57-8586-39a8c2f2a293', 'fd4746a8-624d-411a-b8a7-b5c965021a51'} {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1098.865458] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1098.870566] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1098.870566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.870685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.870874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.871093] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.871205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.871266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.871415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.871490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.871568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.871654] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.885754] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.886757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.886757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.886910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.886972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.889395] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1098.889395] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1098.889395] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1098.952755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.952942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.954496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.954821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.955991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.956307] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1098.956403] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1098.956515] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1098.956544] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1098.956600] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1098.956682] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGH for action security_group_rules [ 1098.956763] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGH for action security_group_rules [ 1098.956884] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGH for action security_group_rules [ 1098.957027] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGH for action security_group_rules [ 1098.957027] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGH for action security_group_rules [ 1098.959565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.134162] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.134162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.134162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.134162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.134162] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.134162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.134162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.135658] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.135980] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.136336] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.136593] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.136891] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.137201] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.137449] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.137683] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.137935] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.157134] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.157134] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1099.157134] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.157134] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.157134] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-5863e72b-7311-42df-b4b8-722214b2b7a6 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.157134] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.157134] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.157134] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.157134] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5863e72b-7311-42df-b4b8-722214b2b7a6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.297800] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.377144] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.660209] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.660439] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.660570] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.660859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.661032] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.661434] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 5863e72b-7311-42df-b4b8-722214b2b7a6 not found, creating... [ 1099.661710] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.661868] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.661984] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.662254] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.662393] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.662674] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.662826] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.662940] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.663162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.663294] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.663489] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 5863e72b-7311-42df-b4b8-722214b2b7a6 is going to be created. [ 1099.683035] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.683258] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.683386] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.683656] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.683970] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.684230] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.694949] env[69219]: INFO networking_nsxv3.common.synchronization [req-bc4a86b5-3ae3-4c7a-8d91-d38b58f7c9da req-655f44e7-accd-4607-83cb-4d7ef7161f1f tempest-ServersV294TestFqdnHostnames-1201944735 tempest-ServersV294TestFqdnHostnames-1201944735-project-member] Enqueued Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_members [ 1099.695581] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGHEST for action security_group_members [ 1099.695752] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc9fb959-a076-420f-a95e-66822d85fa97 with Priority: HIGH for action security_group_rules [ 1099.695871] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGH for action security_group_rules [ 1099.695983] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 with Priority: HIGH for action security_group_rules [ 1099.696105] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 with Priority: HIGH for action security_group_rules [ 1099.696748] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e223c622-11b3-472e-bc32-fa212373c375 with Priority: HIGH for action security_group_rules [ 1099.696929] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e92a878-87ba-416d-b225-777db5147611 with Priority: HIGH for action security_group_rules [ 1099.697197] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1de8e111-6e0d-48d0-816d-62134145ea0f with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGH for action security_group_rules [ 1099.698180] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b911077-41e4-4e60-b59f-e672bb56c601 with Priority: HIGH for action security_group_rules [ 1099.698587] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGH for action security_group_rules [ 1099.698587] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 with Priority: HIGH for action security_group_rules [ 1099.698587] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGH for action security_group_rules [ 1099.698733] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.698866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.699054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.699298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.699479] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.699590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.699645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.699809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.699911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.700007] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.700872] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc9fb959-a076-420f-a95e-66822d85fa97 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.700978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.701120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.701283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.701361] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc9fb959-a076-420f-a95e-66822d85fa97',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.702301] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.702414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.702480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.702631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.702731] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.703376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.703481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.703548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.703691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.703761] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b8eea57-ce57-4940-9c1a-cd39d18803e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.704429] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.704537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.704604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.704750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.704822] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825c0c18-33c1-4cb4-8480-e8d82499bbf3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.705594] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e223c622-11b3-472e-bc32-fa212373c375 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.705704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.705769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.705915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.705986] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e223c622-11b3-472e-bc32-fa212373c375',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.706766] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e92a878-87ba-416d-b225-777db5147611 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.706899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.706931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.707089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.707163] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e92a878-87ba-416d-b225-777db5147611',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.707853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e07acd6-602d-48e1-bdfd-e4378ff72832 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.707962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.708042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.708190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.708270] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e07acd6-602d-48e1-bdfd-e4378ff72832',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.708960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.709157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.709219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.709341] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.709413] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5538c90-15d8-4803-8aa4-ad7aa2b015b1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.710476] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1de8e111-6e0d-48d0-816d-62134145ea0f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.710788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.710876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.711247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.711319] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1de8e111-6e0d-48d0-816d-62134145ea0f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.711974] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.712113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.712191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.712362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.712432] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.713129] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.713249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.713309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.713471] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.713543] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c5354b9-81f9-4e22-bc81-6b10e24e0c2c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.714231] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.714420] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.714491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.714711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.714787] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.715487] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7320ab62-aefe-4739-a54e-e995c8c00fd4 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.715595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.715694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.715812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.715905] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7320ab62-aefe-4739-a54e-e995c8c00fd4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.716604] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bbfcc96-5e86-4201-bca0-faab328daf1d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.716716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.716800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.716959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.717053] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bbfcc96-5e86-4201-bca0-faab328daf1d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.717876] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4dd29e2-bd83-4aa6-8057-859cad475a65 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.717959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.718046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.718250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.718294] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4dd29e2-bd83-4aa6-8057-859cad475a65',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.719117] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.719243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.719311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.719481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.719563] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.720253] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b911077-41e4-4e60-b59f-e672bb56c601 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.720433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.720433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.720560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.720628] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b911077-41e4-4e60-b59f-e672bb56c601',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.721773] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.721914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.721993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.722234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.722263] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.725642] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.725755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.725820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.726116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.726116] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21d8fe10-76ad-439c-96a8-ed7e1f50f5c2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.726820] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.726917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.726964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.727126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.727199] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.803048] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.877340] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39c47700-2196-4adc-afd5-b72e818055ee: rpc.has_security_group_logging(os_id): False [ 1099.900048] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.900048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.900048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.900048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.919495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.919808] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.919961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.920517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.920517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.920628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.920660] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1099.976201] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.976402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.976491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.976692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.976853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.989957] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1100.230010] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.230129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.230681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.230681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.230681] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.230681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.230871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.230871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.230933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.231092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.231192] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.238664] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.238780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.238867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.239104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.242264] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.242264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.242264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.242264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.242264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.242264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.242264] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.248290] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.248559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.248559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.248703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.248843] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.248936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.248997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.249148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.249230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.249325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.249396] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.255453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.255584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.255641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.255910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.267175] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.268450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.268450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.268450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.268450] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.268450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.268724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.268724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.268781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.268937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.269013] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.281905] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.312661] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.312976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.312976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.313212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.313585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.313668] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be updated. [ 1100.316424] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.316612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.317413] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.317574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.318462] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.318612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.321063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.321205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.322034] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.322161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.329172] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.329335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.330200] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.330333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.331144] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.331277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.332088] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.332242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.332983] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.333121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.333757] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1100.334208] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.334340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.335120] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1100.337291] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.337291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.337291] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1100.337291] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.337291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.337844] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1100.338917] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.338917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.338917] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1100.340863] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.340863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.340863] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1100.340863] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.340863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.341776] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1100.342452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.342452] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.342585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.342932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.342932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.342932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.343115] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfae446e-9362-456c-b5ff-375627350736 is going to be updated. [ 1100.344072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.344901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.353204] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.353204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.353204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.353423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.353899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.362691] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: IN_PROGRESS for 2s [ 1100.362691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.362691] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c5354b9-81f9-4e22-bc81-6b10e24e0c2c is going to be deleted. [ 1100.362691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.362691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.372558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.372702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.372770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.372964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.373101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.382275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.382396] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be deleted. [ 1100.383304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.383488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.385015] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfae446e-9362-456c-b5ff-375627350736 in Status: IN_PROGRESS for 2s [ 1100.400091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.400245] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e223c622-11b3-472e-bc32-fa212373c375 is going to be deleted. [ 1100.401198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.401427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.418174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.418421] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e07acd6-602d-48e1-bdfd-e4378ff72832 is going to be deleted. [ 1100.419290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.419588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.438156] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.438313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.441284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.441284] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825c0c18-33c1-4cb4-8480-e8d82499bbf3 is going to be deleted. [ 1100.441284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.441284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.443651] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.443651] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.444639] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.444730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.446319] env[69219]: INFO networking_nsxv3.common.synchronization [req-52ddc645-b364-4d39-b764-72b947f075aa req-d7ab3707-fc5c-4d19-98f4-c1192b335e73 service nova] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1100.446495] env[69219]: INFO networking_nsxv3.common.synchronization [req-52ddc645-b364-4d39-b764-72b947f075aa req-d7ab3707-fc5c-4d19-98f4-c1192b335e73 service nova] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1100.446640] env[69219]: INFO networking_nsxv3.common.synchronization [req-52ddc645-b364-4d39-b764-72b947f075aa req-d7ab3707-fc5c-4d19-98f4-c1192b335e73 service nova] Enqueued Resource ID: 5863e72b-7311-42df-b4b8-722214b2b7a6 with Priority: HIGHEST for action port [ 1100.446859] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_rules [ 1100.446988] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1100.447100] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5863e72b-7311-42df-b4b8-722214b2b7a6 with Priority: HIGHEST for action port [ 1100.447625] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.447742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.447802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.447984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.448076] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.448886] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.448991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.449182] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-5863e72b-7311-42df-b4b8-722214b2b7a6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.449281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.449343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.449502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.449586] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5863e72b-7311-42df-b4b8-722214b2b7a6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.462258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.462376] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bbfcc96-5e86-4201-bca0-faab328daf1d is going to be deleted. [ 1100.463484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.463693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.477752] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 in Status: SUCCESS [ 1100.477938] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 deletion is rescheduled due to dependency. [ 1100.478044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.480614] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.480735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.495084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.495222] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be deleted. [ 1100.496185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.496392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.534511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.537638] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b8eea57-ce57-4940-9c1a-cd39d18803e2 is going to be deleted. [ 1100.537638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.537638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.547583] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.547700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.571835] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.571835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.595827] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1100.595978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.610543] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.610676] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21d8fe10-76ad-439c-96a8-ed7e1f50f5c2 is going to be deleted. [ 1100.611714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.611920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.636285] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.636413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.662122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.662266] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5538c90-15d8-4803-8aa4-ad7aa2b015b1 is going to be deleted. [ 1100.663401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.663401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.716010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.716157] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1de8e111-6e0d-48d0-816d-62134145ea0f is going to be deleted. [ 1100.717047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.719669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.723120] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.723234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.746860] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.747043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.747289] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.747400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.747481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.747697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.747845] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.747935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.748009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.748157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.748260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.748345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.748489] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.748581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.748638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.748834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.748927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.749043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.749134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.749301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.749382] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.749466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.749560] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.750562] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.750663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.750729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.750888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.751107] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.751214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.751350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.751418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.751495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.751575] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.751717] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.751807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.751868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.752015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.752177] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.752266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.752314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.752452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.752524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.752603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.752680] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.763798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.763913] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4dd29e2-bd83-4aa6-8057-859cad475a65 is going to be deleted. [ 1100.764931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.765143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.777305] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.787835] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8: rpc.has_security_group_logging(os_id): False [ 1100.795619] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.795733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.808602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.808740] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc9fb959-a076-420f-a95e-66822d85fa97 is going to be deleted. [ 1100.809793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.810102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.825046] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.825182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.853105] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.853236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.866427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.866548] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7320ab62-aefe-4739-a54e-e995c8c00fd4 is going to be deleted. [ 1100.867445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.867653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.936497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.936674] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b911077-41e4-4e60-b59f-e672bb56c601 is going to be deleted. [ 1100.937701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.937942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.951681] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.951853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.952051] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5863e72b-7311-42df-b4b8-722214b2b7a6 with status ACTIVE [ 1100.952434] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.952434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.952434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.953099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.953099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.953099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.953099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.953099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.953505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.953505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.953505] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.953606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.953606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.953741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.953810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.953903] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5863e72b-7311-42df-b4b8-722214b2b7a6 is going to be updated. [ 1100.971945] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.972150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.972969] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.973114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.984776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.984898] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e92a878-87ba-416d-b225-777db5147611 is going to be deleted. [ 1100.985877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.986096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.986190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.986314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c5354b9-81f9-4e22-bc81-6b10e24e0c2c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.986483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.986639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.986733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.986843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e223c622-11b3-472e-bc32-fa212373c375" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.987347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.987522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.987610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.987716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.987857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.988025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.988107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.988220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e07acd6-602d-48e1-bdfd-e4378ff72832" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.988343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.988495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.988570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.988679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825c0c18-33c1-4cb4-8480-e8d82499bbf3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.988802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.988957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.989051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.989181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bbfcc96-5e86-4201-bca0-faab328daf1d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.989309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.989472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.989549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.989671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.989794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.989944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.990035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.990161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21d8fe10-76ad-439c-96a8-ed7e1f50f5c2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.990861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.991069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.991180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.991266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b8eea57-ce57-4940-9c1a-cd39d18803e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.991406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.991548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.991637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.991762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5538c90-15d8-4803-8aa4-ad7aa2b015b1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.991865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.991998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.992082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.992189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1de8e111-6e0d-48d0-816d-62134145ea0f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.992313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.992448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.994395] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.994506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.994542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.994682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.994804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.994944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5863e72b-7311-42df-b4b8-722214b2b7a6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.996429] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.996534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.025934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.025934] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.025934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.025934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.025934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.025934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.026201] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 is going to be updated. [ 1101.027018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.027198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.027410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.027563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc9fb959-a076-420f-a95e-66822d85fa97" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.027688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.027833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.027911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.028027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4dd29e2-bd83-4aa6-8057-859cad475a65" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.028212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.028362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.028439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.028548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7320ab62-aefe-4739-a54e-e995c8c00fd4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.123572] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.123953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.123953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.124079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.124146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.124269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e92a878-87ba-416d-b225-777db5147611" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.125014] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.125132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.125201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.125393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.125474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.125580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b911077-41e4-4e60-b59f-e672bb56c601" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.165032] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1101.165596] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.165731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.165819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.165988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.166312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.186453] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: IN_PROGRESS for 2s [ 1101.254432] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39e3a8ce-a00d-4a24-8049-ab1615d53479: rpc.has_security_group_logging(os_id): False [ 1101.255686] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 1101.280595] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ca12f68-e96e-40a5-86d0-c5aa6f465be8: rpc.has_security_group_logging(os_id): False [ 1101.304409] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.304409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.304409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.304409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.306077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.306183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.306883] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.307022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.338466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.338841] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.338969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.339061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.339273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.339359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.339465] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 is going to be updated. [ 1101.340869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.341093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.390741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.391092] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.391230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.391318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.391521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.391611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.391810] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.391906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.391967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.392141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.392235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.392429] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.392508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.392568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.392709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.392783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.392862] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1101.393933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.394358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.439433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.439675] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.439797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.439866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.440106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.440199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.440419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.440548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.440641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.440793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.440871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.441151] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.441250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.441310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.441452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.441526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.441611] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 is going to be updated. [ 1101.443333] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.443452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.443538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.443690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.443817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.463452] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: IN_PROGRESS for 2s [ 1101.526405] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.526583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.526620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.526813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.527026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.551458] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.551458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.551458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.551650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.551741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.566331] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1101.571224] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: IN_PROGRESS for 2s [ 1102.001282] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1102.001483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.370776] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: SUCCESS [ 1102.371307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.371573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.371873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.372195] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.372381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.372509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.372737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.372898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.372990] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.395236] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfae446e-9362-456c-b5ff-375627350736 in Status: SUCCESS [ 1102.395500] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfae446e-9362-456c-b5ff-375627350736 deletion is rescheduled due to dependency. [ 1102.395694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.877146] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.199671] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: SUCCESS [ 1103.199671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.378453] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.475870] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: SUCCESS [ 1103.476134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.578520] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1103.578760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.592043] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: SUCCESS [ 1103.592291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.636687] env[69219]: INFO networking_nsxv3.common.synchronization [req-936947c0-f555-47e7-b7dc-49ed770a4680 req-3dc201f8-4c91-4bf2-958e-fdf67881b109 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1103.637223] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1103.637529] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.637648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.637707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.637906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.643166] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.644206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.644206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.644206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.644206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.644206] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.693865] env[69219]: INFO networking_nsxv3.common.synchronization [req-40088914-7964-4b36-a785-77b2cae0cf11 req-65e65200-742f-46e0-9585-d949262e4d70 tempest-InstanceActionsV221TestJSON-2085827730 tempest-InstanceActionsV221TestJSON-2085827730-project-member] Enqueued Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_members [ 1103.694375] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGHEST for action security_group_members [ 1103.694689] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.695230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.695305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.695507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.695671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.695800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.695865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.696029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.696126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.696224] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.881213] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.881687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.881687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.881797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.881859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.881954] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be updated. [ 1103.908345] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.908501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.908545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.908779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.908935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.916568] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: IN_PROGRESS for 2s [ 1104.149107] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.149289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.149353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.149596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.149708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.149880] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.149987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.150068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.150205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.150281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.150367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1104.176867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.177100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.177100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.177340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.177467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.186163] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1104.201729] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.201957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.201957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.202249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.202352] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.202558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.202658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.202721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.202873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.202949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.203043] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 is going to be updated. [ 1104.230863] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.231105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.231165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.231349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.231489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.239938] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: IN_PROGRESS for 2s [ 1104.526171] env[69219]: INFO networking_nsxv3.common.synchronization [req-d84c5c96-070e-4ef8-af20-45db273f550c req-a4ce0290-5afb-4248-9bf9-8f0b5366ec59 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1104.526776] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1104.527105] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.527226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.527289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.527485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.527629] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.527725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.527874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.527942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.528024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.528109] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.798999] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.799235] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.799363] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.799623] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.799890] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.800062] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.800198] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.800421] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.800571] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.800778] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.800896] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.801336] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.801336] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.802035] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.802035] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.802035] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.818970] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.819168] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.819317] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.819498] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-753" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.819822] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-66e82503-bef4-4296-9ec2-3f2be744ebd3 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.820008] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.820218] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.820461] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.820606] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66e82503-bef4-4296-9ec2-3f2be744ebd3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.031115] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.031115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.031115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.031115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.031115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.031115] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.031115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.031421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.031421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.031421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.031498] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be deleted. [ 1105.059785] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.059937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.060020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.060218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.060309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.060465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.323679] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.323679] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.323679] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.324067] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.324067] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.324229] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 66e82503-bef4-4296-9ec2-3f2be744ebd3 not found, creating... [ 1105.324475] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.324689] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.324843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.325095] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.325248] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.325541] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.325705] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.325865] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.326029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.326208] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.326408] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 66e82503-bef4-4296-9ec2-3f2be744ebd3 is going to be created. [ 1105.347786] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.348069] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.348170] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.348539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.349152] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.349152] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.928335] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: SUCCESS [ 1105.928618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.928737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.928902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.929116] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.929231] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.929296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.929448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.929530] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.929613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.929702] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.035941] env[69219]: INFO networking_nsxv3.common.synchronization [req-d84c5c96-070e-4ef8-af20-45db273f550c req-8b9b5a96-88d3-4ff4-85ab-15bb1427685a service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 1106.036312] env[69219]: INFO networking_nsxv3.common.synchronization [req-d84c5c96-070e-4ef8-af20-45db273f550c req-8b9b5a96-88d3-4ff4-85ab-15bb1427685a service nova] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1106.036494] env[69219]: INFO networking_nsxv3.common.synchronization [req-d84c5c96-070e-4ef8-af20-45db273f550c req-8b9b5a96-88d3-4ff4-85ab-15bb1427685a service nova] Enqueued Resource ID: 66e82503-bef4-4296-9ec2-3f2be744ebd3 with Priority: HIGHEST for action port [ 1106.036606] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_rules [ 1106.036739] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1106.037535] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66e82503-bef4-4296-9ec2-3f2be744ebd3 with Priority: HIGHEST for action port [ 1106.037927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.038065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.038129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.038328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.038623] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.039203] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.039852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.039852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.039852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.039852] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.039852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.039852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.040082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.040082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.040132] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.040950] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-66e82503-bef4-4296-9ec2-3f2be744ebd3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.041090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.041160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.041312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.041403] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66e82503-bef4-4296-9ec2-3f2be744ebd3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.195357] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1106.195523] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 1106.195642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.249245] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 in Status: SUCCESS [ 1106.249431] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 deletion is rescheduled due to dependency. [ 1106.249549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.433162] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.543128] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.544217] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.544336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.545592] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66e82503-bef4-4296-9ec2-3f2be744ebd3 with status ACTIVE [ 1106.545766] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.545877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.545942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.546222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.546333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.546511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.546611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.546670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.546846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.546923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.547118] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.547214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.547274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.547411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.547483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.547565] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66e82503-bef4-4296-9ec2-3f2be744ebd3 is going to be updated. [ 1106.568558] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.568715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.568764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.568950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.569153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.569325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66e82503-bef4-4296-9ec2-3f2be744ebd3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.935545] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb30b358-da7b-4abc-ac4d-7b6b8baeed61: rpc.has_security_group_logging(os_id): False [ 1106.953563] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.953829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.953980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.954337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.972083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.972416] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.972537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.972605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.972805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.972894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.972979] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be updated. [ 1107.028670] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.028820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.028886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.029133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.029282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.040245] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: IN_PROGRESS for 2s [ 1107.049549] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.551540] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.551726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.551815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.552136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.552242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.552345] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be created. [ 1107.574622] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.574814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.574814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.574953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.575118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.583899] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: UNINITIALIZED for 2s [ 1109.054391] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: SUCCESS [ 1109.054391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.489928] env[69219]: INFO networking_nsxv3.common.synchronization [None req-461b0621-1a4b-4abd-b4c9-7dd63689a228 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1109.490504] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1109.490818] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.490943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.491129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.491400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.491752] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.491809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.491895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.492185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.492326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.492461] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.599772] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 1109.600031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.600241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.600490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.600690] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.600807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.600867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.601031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.601164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.601296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.601341] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.994647] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.994881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.995032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.995374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.015839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.016331] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.016566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.016725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.017167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.017319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.017443] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 1110.043909] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.044101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.044163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.044374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.044580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.054634] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 1110.103623] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.103854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.103854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.104114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.104290] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.104393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.104458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.104614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.104696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.104780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.104928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.105040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.105103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.105244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.105392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.105522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.105605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.105804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.105901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.105997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.106145] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.611455] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03b383a8-62e8-454b-9d3c-ac3de2f9ba05: rpc.has_security_group_logging(os_id): False [ 1110.633173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.633361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.633436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.633659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.633748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.633956] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.637181] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.637181] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.637181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.637181] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be created. [ 1110.693993] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.694847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.694847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.694847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.694978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.713495] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 1112.065629] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 1112.065629] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 deletion is rescheduled due to dependency. [ 1112.065947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.727093] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 1112.727325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.170493] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.170493] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.170493] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.170831] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.171411] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.171939] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.172104] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.172364] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.172519] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.172735] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.172855] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.172969] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.173101] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.173287] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.173466] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.173624] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.193575] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.193575] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1113.193575] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.193733] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.194150] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-47873a23-9b4f-4073-b2d5-c5c11395cdb6 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.194315] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.194315] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.194644] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.194787] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47873a23-9b4f-4073-b2d5-c5c11395cdb6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.699703] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.699703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.699703] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.700542] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.700542] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.700542] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 47873a23-9b4f-4073-b2d5-c5c11395cdb6 not found, creating... [ 1113.700914] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.701189] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.701381] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.701666] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.701915] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.702337] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.702582] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.702937] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.703067] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.703311] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.703525] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 is going to be created. [ 1113.723262] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.723492] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.723688] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.723907] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.724157] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.724407] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.495019] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1114.495019] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1114.526210] env[69219]: INFO networking_nsxv3.common.synchronization [req-2179884e-8bd0-48ac-a0fe-7521495d73d9 req-661f309d-97ee-46a4-b841-44a234db1202 service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 1114.526210] env[69219]: INFO networking_nsxv3.common.synchronization [req-2179884e-8bd0-48ac-a0fe-7521495d73d9 req-661f309d-97ee-46a4-b841-44a234db1202 service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1114.526210] env[69219]: INFO networking_nsxv3.common.synchronization [req-2179884e-8bd0-48ac-a0fe-7521495d73d9 req-661f309d-97ee-46a4-b841-44a234db1202 service nova] Enqueued Resource ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 with Priority: HIGHEST for action port [ 1114.526210] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 1114.526210] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1114.526210] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 with Priority: HIGHEST for action port [ 1114.526210] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.526210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.526210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.526210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.526210] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.535104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.535104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.535104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.535104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.535104] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.535104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.535104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.535104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.535104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.535104] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.536082] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-47873a23-9b4f-4073-b2d5-c5c11395cdb6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.536289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.536426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.536657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.536883] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47873a23-9b4f-4073-b2d5-c5c11395cdb6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.037832] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.038933] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.039452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.039952] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47873a23-9b4f-4073-b2d5-c5c11395cdb6 with status ACTIVE [ 1115.040235] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.040421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.040512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.040797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.040938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.041263] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.041355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.041497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.044053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.044053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.044053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.044053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.044053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.044053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.044053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.044053] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 is going to be updated. [ 1115.065027] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.065939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.066100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.066439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.066688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.066956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.340031] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5f670119-db78-4927-a97c-2576374ee7bd None None] Enqueued Resource ID: dd0d1291-d99a-46b6-93f6-0f932af69103 with Priority: HIGHEST for action port [ 1115.345017] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd0d1291-d99a-46b6-93f6-0f932af69103 with Priority: HIGHEST for action port [ 1115.345017] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd0d1291-d99a-46b6-93f6-0f932af69103 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.345017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd0d1291-d99a-46b6-93f6-0f932af69103" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.345017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd0d1291-d99a-46b6-93f6-0f932af69103" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.345017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd0d1291-d99a-46b6-93f6-0f932af69103" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.345017] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd0d1291-d99a-46b6-93f6-0f932af69103',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.539775] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.849796] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd0d1291-d99a-46b6-93f6-0f932af69103 [ 1115.849796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.849796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.849796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.849796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.849796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.849796] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd0d1291-d99a-46b6-93f6-0f932af69103 already deleted. [ 1115.849796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd0d1291-d99a-46b6-93f6-0f932af69103" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.041773] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.041910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.041910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.042892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.042892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.042892] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 1116.072020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.072020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.072020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.072020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.072020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.082209] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 1117.364844] env[69219]: INFO networking_nsxv3.common.synchronization [req-3ef87b00-dec6-4720-96e4-8a01444101c1 req-9d40952d-6f3b-4fe1-a3aa-b61d71e47d16 tempest-MigrationsAdminTest-1548575404 tempest-MigrationsAdminTest-1548575404-project-member] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1117.368012] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1117.368012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.368012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.368012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.368012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.368012] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.368012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.368012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.368012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.368012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.368012] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.543315] env[69219]: INFO networking_nsxv3.common.synchronization [None req-839962a8-dbc2-499a-b4b8-051a98077418 tempest-ServersTestBootFromVolume-2130099946 tempest-ServersTestBootFromVolume-2130099946-project-member] Enqueued Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_rules [ 1117.543959] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_rules [ 1117.544316] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.544469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.544551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.544831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.544930] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.656671] env[69219]: INFO networking_nsxv3.common.synchronization [None req-d399e52d-a6c2-4733-a01e-27cf2bc7c394 tempest-ServersTestBootFromVolume-2130099946 tempest-ServersTestBootFromVolume-2130099946-project-member] Enqueued Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_rules [ 1117.657274] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_rules [ 1117.657582] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.657685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.819617] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4be554d0-67c8-467d-87b3-ed288ef05d50 None None] Enqueued Resource ID: 857f3ef0-6530-4ab0-8832-9a9a42dca431 with Priority: HIGHEST for action port [ 1117.819617] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857f3ef0-6530-4ab0-8832-9a9a42dca431 with Priority: HIGHEST for action port [ 1117.819617] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-857f3ef0-6530-4ab0-8832-9a9a42dca431 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.819617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-857f3ef0-6530-4ab0-8832-9a9a42dca431" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.819617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-857f3ef0-6530-4ab0-8832-9a9a42dca431" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.819852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-857f3ef0-6530-4ab0-8832-9a9a42dca431" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.819902] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('857f3ef0-6530-4ab0-8832-9a9a42dca431',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.870612] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.072276] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.072276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.072276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.074484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.074484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.074484] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92070d36-6e2b-4078-b921-3446274e3448 already deleted. [ 1118.074484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.074484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.074484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.074484] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.094367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.094367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.094367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.094367] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.322867] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 857f3ef0-6530-4ab0-8832-9a9a42dca431 [ 1118.322867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.323033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.323095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.323308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.323404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.323526] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:857f3ef0-6530-4ab0-8832-9a9a42dca431 already deleted. [ 1118.323616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-857f3ef0-6530-4ab0-8832-9a9a42dca431" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.372332] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.594884] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.595550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.595711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.595941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.596046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.596150] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92070d36-6e2b-4078-b921-3446274e3448 already deleted. [ 1118.596234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.596553] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.596661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.596725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.596908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.597092] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.597191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.597255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.597401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.597478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.597560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.597702] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.597792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.597852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.597985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.598134] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.598226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.598286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.598419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.598491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.598571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.598659] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.881947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.881947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.881947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.882254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.882381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.882544] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be updated. [ 1118.910828] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.911192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.911300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.911490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.911640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.920069] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: IN_PROGRESS for 2s [ 1119.100959] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0687614d-5fbe-486f-942e-47e8dcdc82e2: rpc.has_security_group_logging(os_id): False [ 1119.120278] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.120477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.120559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.120808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.120920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.121254] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.121385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.121466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.121737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.121737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.122177] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.122177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.122177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.123405] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.123523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.123735] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.123833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.123893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.124049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.124161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.124265] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 1119.181138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.181138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.181138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.181138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.181384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.194754] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 1120.930057] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: SUCCESS [ 1120.930327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.179995] env[69219]: INFO networking_nsxv3.common.synchronization [req-4a007d57-b9be-4bef-b887-ca2f04bec4ce req-c6be3664-45f4-4c56-b620-da49f873ade4 tempest-ServerDiskConfigTestJSON-1077033332 tempest-ServerDiskConfigTestJSON-1077033332-project-member] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1121.181726] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGHEST for action security_group_members [ 1121.182212] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.185221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.185221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.185221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.185221] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.185221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.185221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.185221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.185221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.185221] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.212098] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 1121.212274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.686649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.687400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.687492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.687700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.687790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.687995] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.688114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.688192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.688325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.688403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.688486] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be updated. [ 1121.729252] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.729438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.729483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.729667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.729809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.738743] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: IN_PROGRESS for 2s [ 1122.432100] env[69219]: INFO networking_nsxv3.common.synchronization [req-c9c8091f-bcd5-4920-9e27-7a4bb72d137b req-afcaf559-13a3-4dee-98b3-e68df9b12fdf tempest-ServersTestManualDisk-73161595 tempest-ServersTestManualDisk-73161595-project-member] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_members [ 1122.432810] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGHEST for action security_group_members [ 1122.433133] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.433257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.433325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.433523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.433671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.433766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.433828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.433977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.434115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.434207] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.939222] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.939434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.939502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.939748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.939843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.940062] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.940162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.940216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.940357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.941259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.941259] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 is going to be updated. [ 1122.970220] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.971035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.971239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.973121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.974135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.985571] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: IN_PROGRESS for 2s [ 1123.747688] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 in Status: SUCCESS [ 1123.747945] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 deletion is rescheduled due to dependency. [ 1123.748071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.994924] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 in Status: SUCCESS [ 1124.995281] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 deletion is rescheduled due to dependency. [ 1124.995355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.044574] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-414 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.044819] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.044957] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.045252] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.045519] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.045685] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.045807] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.046029] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.046182] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.046447] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.046594] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.046711] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.046825] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.046940] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.047412] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.047601] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.073967] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.074187] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1125.074324] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.074673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-414" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.075040] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.075247] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.075378] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.075672] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.075826] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8d4a76-79d8-4864-94c3-e4e7654d18fa',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.578149] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.578520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.578681] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.579016] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.579245] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.579635] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.579826] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.579952] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.580207] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.580358] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.580663] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.580831] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.580952] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.581254] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.581415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.581568] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa is going to be updated. [ 1125.602087] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.602304] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.602445] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.602688] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.602879] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.603113] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.340141] env[69219]: INFO networking_nsxv3.common.synchronization [req-29be8152-ffab-4c88-8c10-a09e7b0d43d7 req-e2ee3120-1239-4648-b5c0-6b4edf5f3af4 service nova] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_rules [ 1126.340141] env[69219]: INFO networking_nsxv3.common.synchronization [req-29be8152-ffab-4c88-8c10-a09e7b0d43d7 req-e2ee3120-1239-4648-b5c0-6b4edf5f3af4 service nova] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1126.340141] env[69219]: INFO networking_nsxv3.common.synchronization [req-29be8152-ffab-4c88-8c10-a09e7b0d43d7 req-e2ee3120-1239-4648-b5c0-6b4edf5f3af4 service nova] Enqueued Resource ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa with Priority: HIGHEST for action port [ 1126.340444] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_rules [ 1126.340444] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1126.340598] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa with Priority: HIGHEST for action port [ 1126.340788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.340918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.341016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.341336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.341419] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.342351] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.342500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.342500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.343450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.343450] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.343450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.343450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.343450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.343450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.343450] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.344402] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.344487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.344521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.344671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.344881] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8d4a76-79d8-4864-94c3-e4e7654d18fa',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.846567] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.846712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.846921] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.847827] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d8d4a76-79d8-4864-94c3-e4e7654d18fa with status ACTIVE [ 1126.849500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.849500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.849500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.849500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.850041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.850041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.850041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.850232] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d8d4a76-79d8-4864-94c3-e4e7654d18fa is going to be updated. [ 1126.868959] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.869121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.869206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.869427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.869565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.869729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d8d4a76-79d8-4864-94c3-e4e7654d18fa" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.352408] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.855494] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.855494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.855609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.855813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.855920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.856339] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be updated. [ 1127.888985] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.888985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.888985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.889274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.889274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.898074] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 1127.904536] env[69219]: INFO networking_nsxv3.common.synchronization [req-0ac2e2ce-f318-4c95-816e-571c7fdcda51 req-13c38f74-9805-4420-9a50-1f2323deb2ac tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1127.905171] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1127.905533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.905676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.905775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.906019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.906215] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.906320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.906395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.906585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.906673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.906770] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.294192] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.294375] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.294532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.294784] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.295055] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.295226] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.295646] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.295896] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.296063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.296286] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.297996] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.297996] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.297996] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.297996] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.297996] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.297996] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.315620] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.315790] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1128.315939] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.316141] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.316456] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b65b459c-b675-4432-b9f7-a6429e29cebe taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.316635] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.316761] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.317174] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.317275] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b65b459c-b675-4432-b9f7-a6429e29cebe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.409605] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.821595] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.821887] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.822086] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.822451] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.822686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.823399] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b65b459c-b675-4432-b9f7-a6429e29cebe not found, creating... [ 1128.827463] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.827697] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.827947] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.828178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.828418] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.828762] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.828949] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.829132] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.829494] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.829740] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.829936] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b65b459c-b675-4432-b9f7-a6429e29cebe is going to be created. [ 1128.852350] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.852350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.852350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.852350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.852350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.852350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.911440] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.414020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.414402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.414402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.414693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.414693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.414693] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1129.441062] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.441290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.441390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.441622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.441769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.450534] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1129.585709] env[69219]: INFO networking_nsxv3.common.synchronization [req-0ac2e2ce-f318-4c95-816e-571c7fdcda51 req-e29116d2-0564-44b9-a784-53107affae12 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1129.585897] env[69219]: INFO networking_nsxv3.common.synchronization [req-0ac2e2ce-f318-4c95-816e-571c7fdcda51 req-e29116d2-0564-44b9-a784-53107affae12 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1129.586058] env[69219]: INFO networking_nsxv3.common.synchronization [req-0ac2e2ce-f318-4c95-816e-571c7fdcda51 req-e29116d2-0564-44b9-a784-53107affae12 service nova] Enqueued Resource ID: b65b459c-b675-4432-b9f7-a6429e29cebe with Priority: HIGHEST for action port [ 1129.586312] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1129.586512] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1129.586586] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b65b459c-b675-4432-b9f7-a6429e29cebe with Priority: HIGHEST for action port [ 1129.587449] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.587449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.587591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.587756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.587792] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.589177] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.589407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.590035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b65b459c-b675-4432-b9f7-a6429e29cebe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.590203] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.590704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.590704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.590704] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b65b459c-b675-4432-b9f7-a6429e29cebe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.829608] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c484f29-6dd5-42d3-96df-eade3375b888 req-2678d7c2-2306-4e39-892e-24e482db0a45 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1129.830920] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1129.831357] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.831544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.831662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.831929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.832192] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.832355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.832467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.832680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.832792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.832909] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.909018] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.909018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.909018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.909018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.090287] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.090446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.092714] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b65b459c-b675-4432-b9f7-a6429e29cebe with status ACTIVE [ 1130.093029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.093179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.093268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.093538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.093671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.093903] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.094063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.094146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.094322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.094404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.094617] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.094749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.094749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.094888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.094931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.095028] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b65b459c-b675-4432-b9f7-a6429e29cebe is going to be updated. [ 1130.115589] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.115589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.115589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.115589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.115589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.115589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b65b459c-b675-4432-b9f7-a6429e29cebe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.150176] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-70 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.150392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.150470] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.150744] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.151046] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.151262] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.151382] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.151620] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.151770] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.151987] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.152158] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.152280] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.152401] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.152529] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1130.152583] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.152720] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.171543] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.171696] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1130.171834] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.172008] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.172311] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c190f116-226f-4d74-b0e3-c1abefef5942 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.172474] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.172597] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.172895] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.173056] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c190f116-226f-4d74-b0e3-c1abefef5942',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.335752] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.337028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.337028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.337028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.337028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.337028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.337028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.337028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.337028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.337375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.337375] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1130.369218] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.369218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.369357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.369613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.369774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.379590] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1130.411188] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.411386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.411464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.411684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.411857] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.411958] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.412032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.412183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.412315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.412408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.412556] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.412647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.412708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.412847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.412983] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.413083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.413146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.413280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.413356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.413437] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.413558] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.675909] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.676328] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.676368] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.676655] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.676806] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.676963] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c190f116-226f-4d74-b0e3-c1abefef5942 not found, creating... [ 1130.677255] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.677483] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.677633] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.677923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.678009] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.678300] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.678469] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.678591] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.678801] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.678938] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.679146] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c190f116-226f-4d74-b0e3-c1abefef5942 is going to be created. [ 1130.697061] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.697357] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.697524] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.697773] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.698036] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.698302] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.916495] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4620fe61-858f-4c22-8abc-d5f135e99e49: rpc.has_security_group_logging(os_id): False [ 1130.935279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.935279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.935279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.935279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.935279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.935279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.935279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.935545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.935545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.935600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.935814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.935926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.935986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.936166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.936239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.936419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.936507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.936565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.936727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.936815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.936902] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be created. [ 1130.995800] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.995800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.995800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.996039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.996324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.010168] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 1131.194439] env[69219]: INFO networking_nsxv3.common.synchronization [req-6d63fd95-5234-4689-bcf9-04fc4ced3e8d req-3036b5af-7266-46d7-afed-097975c3d5ec tempest-MigrationsAdminTest-1548575404 tempest-MigrationsAdminTest-1548575404-project-member] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1131.195019] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGHEST for action security_group_members [ 1131.195335] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.195463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.195528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.195725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.195870] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.195973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.196613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.196814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.196915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.197020] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.462404] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c484f29-6dd5-42d3-96df-eade3375b888 req-ead79197-a700-4394-ad12-2f29b4f5c075 service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 1131.462669] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c484f29-6dd5-42d3-96df-eade3375b888 req-ead79197-a700-4394-ad12-2f29b4f5c075 service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1131.463262] env[69219]: INFO networking_nsxv3.common.synchronization [req-4c484f29-6dd5-42d3-96df-eade3375b888 req-ead79197-a700-4394-ad12-2f29b4f5c075 service nova] Enqueued Resource ID: c190f116-226f-4d74-b0e3-c1abefef5942 with Priority: HIGHEST for action port [ 1131.464729] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1131.464729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.465403] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 1131.465581] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1131.465767] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c190f116-226f-4d74-b0e3-c1abefef5942 with Priority: HIGHEST for action port [ 1131.466054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.466354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.466642] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.466807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.466895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.467193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.467313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.467440] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.470130] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.470130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.470130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.470266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.470300] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.471191] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.471334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.471561] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c190f116-226f-4d74-b0e3-c1abefef5942 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.471684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.471733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.471881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.471955] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c190f116-226f-4d74-b0e3-c1abefef5942',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.701532] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.701922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.701922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.702165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.721555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.721816] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.721947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.722013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.722280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.722370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.722410] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be updated. [ 1131.747858] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.748408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.748509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.748767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.748933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.757119] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: IN_PROGRESS for 2s [ 1131.973949] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.975187] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.975187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.979081] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c190f116-226f-4d74-b0e3-c1abefef5942 with status ACTIVE [ 1131.979337] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.979601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.980502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.980502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.980502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.980502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.980502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.980502] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.980791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.980791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.980791] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.980988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.980988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.982051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.982051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.982051] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c190f116-226f-4d74-b0e3-c1abefef5942 is going to be updated. [ 1132.002369] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.002482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.002571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.002980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.004600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.004600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c190f116-226f-4d74-b0e3-c1abefef5942" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.064388] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.064492] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.064551] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.064896] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.065316] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.065608] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.065821] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.066110] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.066295] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.066517] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.066652] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.066767] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.066880] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.067007] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.067229] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.067298] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.105295] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.105522] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.105645] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.105833] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-795" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.106178] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-47873a23-9b4f-4073-b2d5-c5c11395cdb6 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.106397] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.106539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.106808] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.106950] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47873a23-9b4f-4073-b2d5-c5c11395cdb6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.390211] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1132.392852] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 1132.392852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.392852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.392852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.392852] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.392852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.392852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.392852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.392852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.392852] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.479750] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.612465] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.612859] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.613039] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.613546] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.613786] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.614198] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.614415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.614637] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.614978] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.615316] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.616250] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.616250] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.616250] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.616677] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.616892] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.617153] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 is going to be updated. [ 1132.648400] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.649561] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.649561] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.649561] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.649561] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.649561] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.895731] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.982751] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.982949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.983065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.983336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.983590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.983590] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1133.009468] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.009628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.009699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.009932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.010093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.020751] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1133.028027] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 1133.028027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.388936] env[69219]: INFO networking_nsxv3.common.synchronization [req-fc6ab9ad-5de3-4146-8322-a36fda816efb req-55d395f3-414d-4d6e-af49-207746c8131b service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 1133.389127] env[69219]: INFO networking_nsxv3.common.synchronization [req-fc6ab9ad-5de3-4146-8322-a36fda816efb req-55d395f3-414d-4d6e-af49-207746c8131b service nova] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1133.389286] env[69219]: INFO networking_nsxv3.common.synchronization [req-fc6ab9ad-5de3-4146-8322-a36fda816efb req-55d395f3-414d-4d6e-af49-207746c8131b service nova] Enqueued Resource ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 with Priority: HIGHEST for action port [ 1133.389535] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_rules [ 1133.389663] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1133.389755] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 with Priority: HIGHEST for action port [ 1133.390407] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.390527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.390593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.390797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.391017] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.394152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.394152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.394152] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.394152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-47873a23-9b4f-4073-b2d5-c5c11395cdb6 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.394152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.394718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.394718] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47873a23-9b4f-4073-b2d5-c5c11395cdb6',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.398779] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.769028] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 in Status: SUCCESS [ 1133.769028] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 deletion is rescheduled due to dependency. [ 1133.769028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.895928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.896342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.896407] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.897356] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47873a23-9b4f-4073-b2d5-c5c11395cdb6 with status ACTIVE [ 1133.897541] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.897720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.897794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.897999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.898138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.898375] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.898478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.898538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.898758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.898837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.898949] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.899569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.899664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.899820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.899897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.899987] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47873a23-9b4f-4073-b2d5-c5c11395cdb6 is going to be updated. [ 1133.901686] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.901842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.901918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.902025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.902134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.902471] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1133.920587] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.920776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.920776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.920956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.921105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.921343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47873a23-9b4f-4073-b2d5-c5c11395cdb6" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.927604] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.927805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.927911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.928114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.928261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.937319] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1134.401949] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.905335] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.905853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.905853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.905853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.906239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.906239] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 1134.931621] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.931844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.931893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.932130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.932404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.940810] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 1135.033032] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1135.033032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.034514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.034841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.035173] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.035386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.035574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.035659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.035802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.035936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.038142] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.543947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.543947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.543947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.543947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.543947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.544729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.544729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.544729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.544729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.544729] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.950535] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1135.950854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.950964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.951212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.951616] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.951759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.951824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.951996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.952110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.952189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.952296] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.047013] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605a443b-d883-4950-9fad-dd508996ac8f: rpc.has_security_group_logging(os_id): False [ 1136.062816] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.062971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.063044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.063256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.081766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.082053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.082178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.082242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.082620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.082620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.082854] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.082986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.083071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.083326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.083424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.083678] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.083816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.083888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.084093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.084199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.084301] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1136.139758] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.139963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.139963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.140209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.140361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.156344] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1136.454741] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.455161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.455786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.456172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.456549] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.456861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.457098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.457395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.457588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.457782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.459025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.459025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.459025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.459025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.459025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.459025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.459025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.459025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.459025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.460594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.460594] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.950635] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 1136.950991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.951066] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.951244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.951579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.951743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.951815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.952098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.952224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.952358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.952510] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.965760] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 1136.989414] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.989535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.989797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.989846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.990096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.990157] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.990235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.990235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.990505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.990632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.990840] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.990926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.991099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.991155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.991207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.991424] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.991519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.991603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.991763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.991835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.991872] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1137.055315] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.055561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.055735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.056182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.056750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.074310] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1137.455860] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.456059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.456059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.456253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.456579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.456730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.456800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.456974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.457072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.457163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.457491] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.457592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.457653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.457800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.457947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.458686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.458823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.459036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.459139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.459302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.459700] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.963987] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0687614d-5fbe-486f-942e-47e8dcdc82e2: rpc.has_security_group_logging(os_id): False [ 1137.984984] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.985418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.987099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.987099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.987099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.987099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.987099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.987099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.987099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.987099] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.987099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.987707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.987707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.987707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.987850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.988141] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.988141] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.988414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.988414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.988488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.988518] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 1138.046810] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.046968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.047046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.047318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.047462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.062563] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 1138.172559] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1138.172670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.390489] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1138.390489] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1138.992145] env[69219]: INFO networking_nsxv3.common.synchronization [None req-12534de7-4c18-497d-b94a-4bcdc197927d None None] Enqueued Resource ID: cdccb1f7-e46f-49ca-8d80-e73aeaa7c790 with Priority: HIGHEST for action port [ 1138.992914] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdccb1f7-e46f-49ca-8d80-e73aeaa7c790 with Priority: HIGHEST for action port [ 1138.993471] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdccb1f7-e46f-49ca-8d80-e73aeaa7c790 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.993671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdccb1f7-e46f-49ca-8d80-e73aeaa7c790" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.993752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdccb1f7-e46f-49ca-8d80-e73aeaa7c790" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.994083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdccb1f7-e46f-49ca-8d80-e73aeaa7c790" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.995625] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdccb1f7-e46f-49ca-8d80-e73aeaa7c790',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.091152] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1139.091152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.497539] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdccb1f7-e46f-49ca-8d80-e73aeaa7c790 [ 1139.498443] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.498785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.498882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.499133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.499229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.499347] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdccb1f7-e46f-49ca-8d80-e73aeaa7c790 already deleted. [ 1139.499441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdccb1f7-e46f-49ca-8d80-e73aeaa7c790" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.083937] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 1140.084321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.693941] env[69219]: INFO networking_nsxv3.common.synchronization [None req-815603e6-3dae-4a35-ae64-04f29f350420 None None] Enqueued Resource ID: 6f2abaa5-a86f-4b47-9eae-9da5d4948107 with Priority: HIGHEST for action port [ 1141.693941] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f2abaa5-a86f-4b47-9eae-9da5d4948107 with Priority: HIGHEST for action port [ 1141.693941] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f2abaa5-a86f-4b47-9eae-9da5d4948107 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.693941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f2abaa5-a86f-4b47-9eae-9da5d4948107" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.693941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f2abaa5-a86f-4b47-9eae-9da5d4948107" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.694784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f2abaa5-a86f-4b47-9eae-9da5d4948107" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.695047] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f2abaa5-a86f-4b47-9eae-9da5d4948107',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.780045] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c3050773-ba21-49eb-b0b0-5e88aa650386 None None] Enqueued Resource ID: fc01ee77-d125-4046-aa50-aa4785351836 with Priority: HIGHEST for action port [ 1141.780045] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc01ee77-d125-4046-aa50-aa4785351836 with Priority: HIGHEST for action port [ 1141.780045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc01ee77-d125-4046-aa50-aa4785351836 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.780045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc01ee77-d125-4046-aa50-aa4785351836" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.780045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc01ee77-d125-4046-aa50-aa4785351836" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.780045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc01ee77-d125-4046-aa50-aa4785351836" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.780045] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc01ee77-d125-4046-aa50-aa4785351836',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.198320] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f2abaa5-a86f-4b47-9eae-9da5d4948107 [ 1142.198580] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.198718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.198788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.199009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.199124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.199213] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f2abaa5-a86f-4b47-9eae-9da5d4948107 already deleted. [ 1142.199300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f2abaa5-a86f-4b47-9eae-9da5d4948107" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.283141] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc01ee77-d125-4046-aa50-aa4785351836 [ 1142.283404] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.284702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.284702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.284702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.284702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.284702] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc01ee77-d125-4046-aa50-aa4785351836 already deleted. [ 1142.284702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc01ee77-d125-4046-aa50-aa4785351836" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.948274] env[69219]: INFO networking_nsxv3.common.synchronization [None req-c539db46-c140-4627-9b41-38d2b31c74b4 None None] Enqueued Resource ID: c9c29dd3-11aa-405d-bcda-b707bed7f35c with Priority: HIGHEST for action port [ 1143.948682] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c29dd3-11aa-405d-bcda-b707bed7f35c with Priority: HIGHEST for action port [ 1143.955762] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9c29dd3-11aa-405d-bcda-b707bed7f35c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.956607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9c29dd3-11aa-405d-bcda-b707bed7f35c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.956701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9c29dd3-11aa-405d-bcda-b707bed7f35c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.956984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9c29dd3-11aa-405d-bcda-b707bed7f35c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.957103] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9c29dd3-11aa-405d-bcda-b707bed7f35c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.462559] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9c29dd3-11aa-405d-bcda-b707bed7f35c [ 1144.462843] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.462983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.463073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.463291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.463378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.463486] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9c29dd3-11aa-405d-bcda-b707bed7f35c already deleted. [ 1144.463552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9c29dd3-11aa-405d-bcda-b707bed7f35c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.398437] env[69219]: INFO networking_nsxv3.common.synchronization [req-73eec24c-6c9c-4b23-bedb-1ff3b90a72fd req-288b725e-ab72-4598-a741-96acbee911b8 tempest-ServersTestBootFromVolume-2130099946 tempest-ServersTestBootFromVolume-2130099946-project-member] Enqueued Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_members [ 1145.399187] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_members [ 1145.399578] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.399697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.399759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.403277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.403277] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.403277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.403277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.403277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.403277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.403277] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.759160] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.759550] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-639" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.759883] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-639" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.760282] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-639" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.761290] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.763245] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.764023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.764023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.764023] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.764168] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.764340] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.764388] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.764533] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.764655] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1145.764751] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.764887] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.785562] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.785562] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1145.785732] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.786175] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-639" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.786288] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-572f4012-d24a-4680-bd49-d166099bde24 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.786514] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.786638] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.787013] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.787219] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('572f4012-d24a-4680-bd49-d166099bde24',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.904119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.904119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.904119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.904348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.904404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.904590] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.904692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.904753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.904907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.904982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.905083] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92070d36-6e2b-4078-b921-3446274e3448 already deleted. [ 1145.905171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.289233] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.289599] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.289735] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.290021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.290182] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.290338] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 572f4012-d24a-4680-bd49-d166099bde24 not found, creating... [ 1146.290614] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.290773] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.290893] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.291133] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.291271] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.291946] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.291946] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.291946] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.292223] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.292387] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.292531] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 572f4012-d24a-4680-bd49-d166099bde24 is going to be created. [ 1146.332132] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.332433] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.332520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.332803] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.333062] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.333481] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.096240] env[69219]: INFO networking_nsxv3.common.synchronization [req-73eec24c-6c9c-4b23-bedb-1ff3b90a72fd req-6ca0de3f-0c93-4332-8f51-45cb5192fd13 service nova] Enqueued Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_rules [ 1147.096551] env[69219]: INFO networking_nsxv3.common.synchronization [req-73eec24c-6c9c-4b23-bedb-1ff3b90a72fd req-6ca0de3f-0c93-4332-8f51-45cb5192fd13 service nova] Enqueued Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_members [ 1147.096916] env[69219]: INFO networking_nsxv3.common.synchronization [req-73eec24c-6c9c-4b23-bedb-1ff3b90a72fd req-6ca0de3f-0c93-4332-8f51-45cb5192fd13 service nova] Enqueued Resource ID: 572f4012-d24a-4680-bd49-d166099bde24 with Priority: HIGHEST for action port [ 1147.097154] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_rules [ 1147.097291] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_members [ 1147.097835] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572f4012-d24a-4680-bd49-d166099bde24 with Priority: HIGHEST for action port [ 1147.099467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.099467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.099467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.099467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.099467] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.100268] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.100268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.100268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.100268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.100454] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.100552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.100614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.100772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.101020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.101152] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.102014] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-572f4012-d24a-4680-bd49-d166099bde24 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.102155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.102226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.102376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.102453] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('572f4012-d24a-4680-bd49-d166099bde24',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.534968] env[69219]: INFO networking_nsxv3.common.synchronization [req-2014a256-89fd-4d29-9380-46a624fdf55d req-7e53f6f5-acaf-474d-a963-a77ae6e06a8a tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1147.536274] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1147.536274] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.536274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.536274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.536512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.536512] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.536595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.536633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.536787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.536891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.536989] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.604179] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.604354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.604712] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.605338] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 572f4012-d24a-4680-bd49-d166099bde24 with status ACTIVE [ 1147.606109] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.606109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.606109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.606109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.606109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.606295] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.606295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.606366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.606617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.606617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.607654] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.607654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.607654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.607654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.607654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.607654] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 572f4012-d24a-4680-bd49-d166099bde24 is going to be updated. [ 1147.635037] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.635219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.635219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.635413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.635553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.635709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-572f4012-d24a-4680-bd49-d166099bde24" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.745163] env[69219]: INFO networking_nsxv3.common.synchronization [req-a30d2b6f-db82-4479-8ef6-28c660e99985 req-169581cb-3341-482c-a30d-1ea66c5bbc26 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1147.745163] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1147.747820] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.748245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.748564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.749018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.749427] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.749765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.750036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.750416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.750698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.751014] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.773021] env[69219]: INFO networking_nsxv3.common.synchronization [None req-4b9b3c08-ada8-458e-9059-c0511b47c19e None None] Enqueued Resource ID: 9c2a23b8-7233-467e-addc-79533c33e956 with Priority: HIGHEST for action port [ 1147.773021] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c2a23b8-7233-467e-addc-79533c33e956 with Priority: HIGHEST for action port [ 1147.773021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c2a23b8-7233-467e-addc-79533c33e956 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.773021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c2a23b8-7233-467e-addc-79533c33e956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.773549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c2a23b8-7233-467e-addc-79533c33e956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.774053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c2a23b8-7233-467e-addc-79533c33e956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.774323] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c2a23b8-7233-467e-addc-79533c33e956',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.038703] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.039213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.039213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.039213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.039391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.039579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.039698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.039756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.039975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.040096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.040275] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1148.072408] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.072408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.072408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.072408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.072408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.079983] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1148.081311] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.081559] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.081686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.081959] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.082932] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.085969] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.085969] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.085969] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.085969] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.085969] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.085969] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.085969] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.085969] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.085969] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.085969] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.085969] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.106223] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.106520] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.106520] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.106697] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.107138] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-89d74d33-c09a-47c3-a490-b05dbc400f6b taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.107360] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.107570] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.108188] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.108360] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d74d33-c09a-47c3-a490-b05dbc400f6b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.109317] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.254323] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.278670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c2a23b8-7233-467e-addc-79533c33e956 [ 1148.278670] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.278670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.278670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.278670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.278670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.278670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c2a23b8-7233-467e-addc-79533c33e956 already deleted. [ 1148.278670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c2a23b8-7233-467e-addc-79533c33e956" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.613199] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.613199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.613199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.613199] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.613385] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.613477] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 89d74d33-c09a-47c3-a490-b05dbc400f6b not found, creating... [ 1148.613831] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.614008] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.614133] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.614362] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.614499] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.614781] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.614934] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.615064] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.615269] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.615402] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.615542] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 89d74d33-c09a-47c3-a490-b05dbc400f6b is going to be created. [ 1148.616714] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.616846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.616901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.617107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.617190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.617274] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92070d36-6e2b-4078-b921-3446274e3448 is going to be created. [ 1148.637521] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.637768] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.637887] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.638161] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.638395] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.638627] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.642020] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.642020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.642136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.642250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.642392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.650987] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92070d36-6e2b-4078-b921-3446274e3448 in Status: UNINITIALIZED for 2s [ 1148.756944] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.260050] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.260050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.260050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.260050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.260050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.260050] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1149.288029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.288029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.288029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.288029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.288029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.301094] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1149.562283] env[69219]: INFO networking_nsxv3.common.synchronization [req-a30d2b6f-db82-4479-8ef6-28c660e99985 req-4be8cabb-831a-438f-b6ab-e10acd68b3d5 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1149.562283] env[69219]: INFO networking_nsxv3.common.synchronization [req-a30d2b6f-db82-4479-8ef6-28c660e99985 req-4be8cabb-831a-438f-b6ab-e10acd68b3d5 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1149.562283] env[69219]: INFO networking_nsxv3.common.synchronization [req-a30d2b6f-db82-4479-8ef6-28c660e99985 req-4be8cabb-831a-438f-b6ab-e10acd68b3d5 service nova] Enqueued Resource ID: 89d74d33-c09a-47c3-a490-b05dbc400f6b with Priority: HIGHEST for action port [ 1149.562283] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1149.562283] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1149.562283] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89d74d33-c09a-47c3-a490-b05dbc400f6b with Priority: HIGHEST for action port [ 1149.562283] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.562283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.562772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.563074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.563262] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.564422] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.564639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.564927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-89d74d33-c09a-47c3-a490-b05dbc400f6b taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.565171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.565338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.565583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.566791] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89d74d33-c09a-47c3-a490-b05dbc400f6b',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.067502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.067666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.067854] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89d74d33-c09a-47c3-a490-b05dbc400f6b with status ACTIVE [ 1150.068064] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.068155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.068211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.068400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.068496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.068650] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.068744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.068798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.068997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.069096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.069224] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.069312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.069359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.069488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.069548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.069638] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89d74d33-c09a-47c3-a490-b05dbc400f6b is going to be updated. [ 1150.091508] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1150.091508] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 1150.091508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.096302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.096302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.096516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.096661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.096735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.096995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89d74d33-c09a-47c3-a490-b05dbc400f6b" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.247560] env[69219]: INFO networking_nsxv3.common.synchronization [None req-7859114a-9f64-454f-be8b-110cf0bab6de None None] Enqueued Resource ID: 2e0efd5c-d3d2-40fb-a69d-b9a342a57334 with Priority: HIGHEST for action port [ 1150.247560] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0efd5c-d3d2-40fb-a69d-b9a342a57334 with Priority: HIGHEST for action port [ 1150.247560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e0efd5c-d3d2-40fb-a69d-b9a342a57334 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.247785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e0efd5c-d3d2-40fb-a69d-b9a342a57334" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.247785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e0efd5c-d3d2-40fb-a69d-b9a342a57334" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.247984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e0efd5c-d3d2-40fb-a69d-b9a342a57334" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.248059] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0efd5c-d3d2-40fb-a69d-b9a342a57334',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.321023] env[69219]: INFO networking_nsxv3.common.synchronization [req-54fd85ec-83b4-4c30-85cc-0d10500c6fd9 req-4eb8f65b-0caa-4d2b-ba47-b214a3dea017 tempest-InstanceActionsTestJSON-1486874820 tempest-InstanceActionsTestJSON-1486874820-project-member] Enqueued Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_members [ 1150.321023] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_members [ 1150.321023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.321023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.321023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.321023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.321023] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.321023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.321023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.321023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.321023] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.322579] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.659934] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92070d36-6e2b-4078-b921-3446274e3448 in Status: SUCCESS [ 1150.660224] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.660403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.660624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.660872] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.660935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.661007] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.661168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.661248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.661331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.661442] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.751110] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e0efd5c-d3d2-40fb-a69d-b9a342a57334 [ 1150.751389] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.751569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.751662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.751934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.752067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.752171] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e0efd5c-d3d2-40fb-a69d-b9a342a57334 already deleted. [ 1150.752845] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e0efd5c-d3d2-40fb-a69d-b9a342a57334" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.766960] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.767280] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-56" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.767422] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-56" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.767781] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-56" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.769534] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.769816] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.770077] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.770531] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.770787] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.771125] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.771319] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1150.771521] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1150.771701] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1150.771885] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.772128] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1150.772833] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1150.795180] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1150.795438] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1150.795686] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1150.795851] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-56" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.796327] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-5b7ae784-218b-4376-8f20-867246508da2 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.796624] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.796929] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.797359] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.797592] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b7ae784-218b-4376-8f20-867246508da2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.825301] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.825455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.825625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.825750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.825858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.826098] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.826324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.826324] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.826554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.826615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.826696] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 already deleted. [ 1150.826803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.995323] env[69219]: INFO networking_nsxv3.common.synchronization [req-fe655d69-68e4-4296-b9f3-d776f3347a21 req-4fffdc61-0c91-428f-b948-744c6dc4235b tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1150.995323] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1150.995323] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.995323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.995793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.995793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.995793] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.995892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.995923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.996083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.996270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.996457] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.165214] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.303236] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.303236] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 5b7ae784-218b-4376-8f20-867246508da2 not found, creating... [ 1151.303236] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.303236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.304058] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.304058] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.304789] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.305149] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.305379] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.305576] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 5b7ae784-218b-4376-8f20-867246508da2 is going to be created. [ 1151.324166] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1151.324728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.324829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.325044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.325252] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.325375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.325439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.325596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.325679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.325812] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.340845] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.341053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.341053] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.341349] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.341640] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.341890] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.498423] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.668582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92070d36-6e2b-4078-b921-3446274e3448: rpc.has_security_group_logging(os_id): False [ 1151.693158] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.693383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.693440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.693648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.693738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.694019] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.694121] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.694181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.694350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.694425] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.694510] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92070d36-6e2b-4078-b921-3446274e3448 is going to be created. [ 1151.764907] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.764907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.764907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.764907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.765304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.778461] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92070d36-6e2b-4078-b921-3446274e3448 in Status: IN_PROGRESS for 2s [ 1151.830256] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.001200] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.170112] env[69219]: INFO networking_nsxv3.common.synchronization [req-54fd85ec-83b4-4c30-85cc-0d10500c6fd9 req-7cf09d95-bf63-4cd4-946e-0d76d992a46c service nova] Enqueued Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_rules [ 1152.170285] env[69219]: INFO networking_nsxv3.common.synchronization [req-54fd85ec-83b4-4c30-85cc-0d10500c6fd9 req-7cf09d95-bf63-4cd4-946e-0d76d992a46c service nova] Enqueued Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_members [ 1152.170433] env[69219]: INFO networking_nsxv3.common.synchronization [req-54fd85ec-83b4-4c30-85cc-0d10500c6fd9 req-7cf09d95-bf63-4cd4-946e-0d76d992a46c service nova] Enqueued Resource ID: 5b7ae784-218b-4376-8f20-867246508da2 with Priority: HIGHEST for action port [ 1152.170938] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_rules [ 1152.171423] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_members [ 1152.171557] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b7ae784-218b-4376-8f20-867246508da2 with Priority: HIGHEST for action port [ 1152.171855] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.171993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.172613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.172753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.172868] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.174325] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.174480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.174520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.174694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.174842] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.174935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.174996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.175155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.175244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.175346] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.176224] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b7ae784-218b-4376-8f20-867246508da2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.176353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.176625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.176786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.177463] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b7ae784-218b-4376-8f20-867246508da2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.333059] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.503914] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.504115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.504187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.504409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.504518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.504618] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be updated. [ 1152.530258] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.533152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.533152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.533152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.533152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.542729] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: IN_PROGRESS for 2s [ 1152.675132] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.675242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.678596] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.679577] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b7ae784-218b-4376-8f20-867246508da2 with status ACTIVE [ 1152.680284] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.680284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.680284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.680284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.680284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.680840] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.680840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.680840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.680840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.680840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.681875] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.681875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.681875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.681875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.681875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.681875] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b7ae784-218b-4376-8f20-867246508da2 is going to be updated. [ 1152.710239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.710398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.710495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.710726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.710877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.711493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b7ae784-218b-4376-8f20-867246508da2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.835788] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.835998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.836113] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.836367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.837583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.837583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1152.876163] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.876163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.876163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.876163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.876163] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.884873] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1153.183718] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.687093] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.687093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.687093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.687093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.687093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.687093] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 is going to be created. [ 1153.709364] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.709566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.709665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.709865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.710045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.720693] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 in Status: UNINITIALIZED for 2s [ 1153.791845] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92070d36-6e2b-4078-b921-3446274e3448 in Status: SUCCESS [ 1153.792065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.551926] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: SUCCESS [ 1154.552257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.894673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1154.895077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.895077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.895388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.895527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.895660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.895660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.895814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.895814] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.896016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.896016] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.399894] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.400105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.400179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.400447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.400672] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.400784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.400858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.401059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.401547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.401547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.401547] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.401816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.401816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.401886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.402038] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.402133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.402214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.402385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.402474] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.402594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.402712] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.730258] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 in Status: SUCCESS [ 1155.730481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.730680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.731012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.731234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.731353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.732443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.732443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.732443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.732443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.732443] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.906251] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605a443b-d883-4950-9fad-dd508996ac8f: rpc.has_security_group_logging(os_id): False [ 1155.926633] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.926830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.926896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.927097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.927189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.927417] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.927679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.927679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.929353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.929353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.929353] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.929353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.929353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.929353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.929353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.931386] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.931568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.931646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.931799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.931877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.932026] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1155.990488] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.990862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.990862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.991094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.991094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.007369] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1156.235039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.235039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.235039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.235510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.235510] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.235510] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.238190] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.238190] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.238190] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.238190] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.739919] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30: rpc.has_security_group_logging(os_id): False [ 1156.761234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.761379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.761489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.761712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.761837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.761993] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.762108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.762173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.762311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.762388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.762599] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.762695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.762777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.762893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.762965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.763183] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.763267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.763338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.763497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.763558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.763604] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 is going to be created. [ 1156.826762] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.826924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.826986] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.827220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.827411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.837538] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 in Status: IN_PROGRESS for 2s [ 1156.918297] env[69219]: INFO networking_nsxv3.common.synchronization [req-439e6f3c-00fc-44bc-ab8d-f6aa3db8e685 req-35bb72be-082d-4f8c-8cf1-4e6edf062f46 tempest-AttachInterfacesV270Test-1044322912 tempest-AttachInterfacesV270Test-1044322912-project-member] Enqueued Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_members [ 1156.918297] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_members [ 1156.918297] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.918297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.918297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.918297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.918297] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.918297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.918297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.918297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.918297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.918297] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.413322] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.413537] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-651" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.413667] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-651" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.414207] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-651" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.414529] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.414698] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.414821] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.415092] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.415347] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.415579] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.415697] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.416201] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.416201] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.416201] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.416322] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.416363] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.423750] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.423917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.423991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.424134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.424220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.424401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.424498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.424559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.424700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.424774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.424855] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 already deleted. [ 1157.424933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.433684] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.433848] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.433987] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.434190] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-651" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.434503] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-0aed48e4-7a57-4614-b51f-55b6f0d6be80 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.434692] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.434830] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.435139] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.435283] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aed48e4-7a57-4614-b51f-55b6f0d6be80',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.938661] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.939077] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.939168] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.939554] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.939732] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.939921] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 0aed48e4-7a57-4614-b51f-55b6f0d6be80 not found, creating... [ 1157.940241] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.940413] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.940538] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.940799] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.940962] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.941298] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.941512] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.941645] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.941974] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.942189] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.942375] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 0aed48e4-7a57-4614-b51f-55b6f0d6be80 is going to be created. [ 1157.967632] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.967870] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.967999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.968396] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.968746] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.969063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.022798] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1158.023059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.851098] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 in Status: SUCCESS [ 1158.851717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.881018] env[69219]: INFO networking_nsxv3.common.synchronization [req-439e6f3c-00fc-44bc-ab8d-f6aa3db8e685 req-ef475bde-e30f-4558-bc36-2d32bc19babd service nova] Enqueued Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_rules [ 1158.881018] env[69219]: INFO networking_nsxv3.common.synchronization [req-439e6f3c-00fc-44bc-ab8d-f6aa3db8e685 req-ef475bde-e30f-4558-bc36-2d32bc19babd service nova] Enqueued Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_members [ 1158.881018] env[69219]: INFO networking_nsxv3.common.synchronization [req-439e6f3c-00fc-44bc-ab8d-f6aa3db8e685 req-ef475bde-e30f-4558-bc36-2d32bc19babd service nova] Enqueued Resource ID: 0aed48e4-7a57-4614-b51f-55b6f0d6be80 with Priority: HIGHEST for action port [ 1158.881018] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_rules [ 1158.881018] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_members [ 1158.881291] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aed48e4-7a57-4614-b51f-55b6f0d6be80 with Priority: HIGHEST for action port [ 1158.881749] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.882187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.882316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.882612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.882690] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.883593] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.883753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.883838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.884110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.884817] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.887331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.887331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.887331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.887331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.887331] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.887331] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aed48e4-7a57-4614-b51f-55b6f0d6be80 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.887331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.887331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.887331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.887331] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aed48e4-7a57-4614-b51f-55b6f0d6be80',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.388402] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.388877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.388877] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aed48e4-7a57-4614-b51f-55b6f0d6be80 with status ACTIVE [ 1159.388877] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.389078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.389129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.389336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.389461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.391281] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.391281] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.391281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.391281] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aed48e4-7a57-4614-b51f-55b6f0d6be80 is going to be updated. [ 1159.392220] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.415143] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.415294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.415368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.415658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.415870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.416269] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aed48e4-7a57-4614-b51f-55b6f0d6be80" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.894195] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.181837] env[69219]: INFO networking_nsxv3.common.synchronization [req-5fa2e18b-b91d-47ef-9e68-a0e3467e8ffd req-31d5ccbd-579a-4863-bf7b-ca903cf1edb4 tempest-ServersNegativeTestJSON-974271614 tempest-ServersNegativeTestJSON-974271614-project-member] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1160.183762] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGHEST for action security_group_members [ 1160.183989] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.184095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.184183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.184430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.184627] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.184799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.184884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.185086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.185193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.185343] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.396617] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.396911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.396911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.397275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.397413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.397570] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 is going to be created. [ 1160.420969] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.421128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.421219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.421496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.421697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.431712] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 in Status: UNINITIALIZED for 2s [ 1160.688857] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.688857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.688857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.689227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.689227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.689533] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.689655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.689723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.690105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.690105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.690105] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be updated. [ 1160.715181] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.715285] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.715329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.715741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.715797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.723586] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: IN_PROGRESS for 2s [ 1161.089265] env[69219]: INFO networking_nsxv3.common.synchronization [req-1c641856-a6d2-4f93-8130-0373897905e3 req-246a6690-ab06-448a-8f13-657c76205733 tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1161.089831] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGHEST for action security_group_members [ 1161.090147] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.090271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.090338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.090529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.090684] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.090780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.091596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.091689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.091801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.091927] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.594734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.595068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.595068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.595165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.595209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.595423] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.595524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.595589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.595746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.595824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.595912] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be updated. [ 1161.644198] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.644339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.644424] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.644645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.644777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.654765] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: IN_PROGRESS for 2s [ 1162.441235] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 in Status: SUCCESS [ 1162.441466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.441637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.441935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.442148] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.442270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.442419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.442558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.442637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.442770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.442824] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.733341] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 in Status: SUCCESS [ 1162.733719] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 deletion is rescheduled due to dependency. [ 1162.733719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.945833] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.946105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.946185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.946509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.946721] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.946878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.946970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.947193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.947342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.947488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.947717] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.947857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.947947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.948184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.948378] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.948556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.948624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.948759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.948843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.948957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.949115] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.451886] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d7564b1-7081-4c22-95c9-b5c511c04590: rpc.has_security_group_logging(os_id): False [ 1163.476385] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.476534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.476625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.476824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.476912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.477113] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.477213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.477319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.477459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.477694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.477807] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.477904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.477959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.478114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.479031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.479031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.479031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.479031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.479031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.479031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.479031] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 is going to be created. [ 1163.538845] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.539053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.539053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.539263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.539491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.549276] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 in Status: IN_PROGRESS for 2s [ 1163.668971] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 in Status: SUCCESS [ 1163.668971] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 deletion is rescheduled due to dependency. [ 1163.668971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.328106] env[69219]: INFO networking_nsxv3.common.synchronization [req-6895bbea-c534-415a-ac81-f424631c32fc req-e90d171a-7105-42b7-8e12-db06761318c9 tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1164.328106] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1164.328106] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.328106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.328106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.328106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.328106] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.328688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.328688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.328688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.328688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.328796] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.612660] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-70 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.612912] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.613063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.613650] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.613650] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.613785] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.613876] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.614206] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.614377] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.614586] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.614703] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.614822] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.614942] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.615058] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1164.615168] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.615343] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.635201] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.635201] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1164.635201] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.635201] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-70" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.635201] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-65df006b-b310-4743-8ebb-aa5b379b64ff taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.635201] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.635201] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.635201] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.635201] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65df006b-b310-4743-8ebb-aa5b379b64ff',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.793582] env[69219]: INFO networking_nsxv3.common.synchronization [req-428c3c22-958a-4aea-a864-1a36a890ca1b req-e5dad0a8-8e1a-49d7-9394-fa4e600a14b4 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1164.794240] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1164.794574] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.794706] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.794826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.795133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.795312] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.795418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.795481] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.795640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.795725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.795814] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.831356] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.831618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.831618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.831855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.831896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.832109] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.832212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.832290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.832430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.832500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.832626] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1164.854560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.854703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.854780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.854951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.855106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.862405] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1165.137452] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.137600] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.137678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.137959] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.138141] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.138302] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 65df006b-b310-4743-8ebb-aa5b379b64ff not found, creating... [ 1165.138562] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.138722] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.138852] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.139092] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.139237] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.139542] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.139744] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.139870] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.140100] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.140244] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.140387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 65df006b-b310-4743-8ebb-aa5b379b64ff is going to be created. [ 1165.159627] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.159862] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.159992] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.160276] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.160512] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.160742] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.298177] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.564716] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 in Status: SUCCESS [ 1165.565068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.800324] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.898137] env[69219]: INFO networking_nsxv3.common.synchronization [req-6895bbea-c534-415a-ac81-f424631c32fc req-acdc6476-06d3-4258-a7e6-70484ed8c00d service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 1165.898382] env[69219]: INFO networking_nsxv3.common.synchronization [req-6895bbea-c534-415a-ac81-f424631c32fc req-acdc6476-06d3-4258-a7e6-70484ed8c00d service nova] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1165.898565] env[69219]: INFO networking_nsxv3.common.synchronization [req-6895bbea-c534-415a-ac81-f424631c32fc req-acdc6476-06d3-4258-a7e6-70484ed8c00d service nova] Enqueued Resource ID: 65df006b-b310-4743-8ebb-aa5b379b64ff with Priority: HIGHEST for action port [ 1165.899150] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_rules [ 1165.899301] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1165.899433] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65df006b-b310-4743-8ebb-aa5b379b64ff with Priority: HIGHEST for action port [ 1165.899720] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.899858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.899940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.900206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.900306] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.901240] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.901340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.901572] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-65df006b-b310-4743-8ebb-aa5b379b64ff taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.901717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.901717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.901887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.901963] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65df006b-b310-4743-8ebb-aa5b379b64ff',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.103276] env[69219]: INFO networking_nsxv3.common.synchronization [None req-b5dac32a-4aa9-40ca-99e2-d058cfeef4d5 tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_rules [ 1166.104067] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_rules [ 1166.104391] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.104499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.104593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.104917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.105169] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.176236] env[69219]: INFO networking_nsxv3.common.synchronization [None req-455670ae-7714-408a-b1df-ae529e371932 tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_rules [ 1166.176752] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_rules [ 1166.177132] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.177221] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.302408] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.302578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.302801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.303026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.303077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.303169] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1166.335095] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.335272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.335327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.335578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.335709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.344406] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1166.403649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.403847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.404162] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65df006b-b310-4743-8ebb-aa5b379b64ff with status ACTIVE [ 1166.404387] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.404571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.404571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.404841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.404969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.405263] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.405469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.405513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.405713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.405809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.406009] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.406140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.406177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.406364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.406452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.406538] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65df006b-b310-4743-8ebb-aa5b379b64ff is going to be updated. [ 1166.427183] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.427282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.427346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.427551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.427710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.427901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65df006b-b310-4743-8ebb-aa5b379b64ff" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.628458] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.628458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.628458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.628458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.628458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.628458] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd2d154-5243-4149-a154-205541ec88ef already deleted. [ 1166.628458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.628458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.628458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.628458] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.870867] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1166.871076] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 1166.871208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.871374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.871666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.871853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.872056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.872122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.872271] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.872353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.872448] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.149947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.150744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.151019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.151357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.151872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.151872] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd2d154-5243-4149-a154-205541ec88ef already deleted. [ 1167.151872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.376056] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.877685] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.354055] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1168.354233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.382046] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.382240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.382325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.382517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.382627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.382760] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1168.409978] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.410188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.410265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.410517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.410696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.418790] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1169.547326] env[69219]: INFO networking_nsxv3.common.synchronization [req-da4f9d18-3012-4c81-98c6-909fd56a94c7 req-08b2129a-cccc-4e6b-8f5b-ad7e808ea3f2 tempest-InstanceActionsTestJSON-1486874820 tempest-InstanceActionsTestJSON-1486874820-project-member] Enqueued Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_members [ 1169.547326] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGHEST for action security_group_members [ 1169.547326] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.547326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.547326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.548726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.549022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.550452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.550452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.550452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.550452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.550452] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.051816] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.053161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.053161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.053161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.053161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.053161] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.053161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.053161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.053660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.053660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.053660] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 is going to be updated. [ 1170.078766] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.080812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.081119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.081556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.081872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.092695] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 in Status: IN_PROGRESS for 2s [ 1170.225687] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.225687] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.225687] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.225972] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.226311] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.226692] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.226911] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.227349] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.227517] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.227870] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.228036] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.228261] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.228644] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.228726] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.228847] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.229083] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.246826] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.246826] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1170.246826] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.246826] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.247353] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9bc79ed1-f427-48b7-9976-7b029eefce81 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.247653] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.247735] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.248172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.248351] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc79ed1-f427-48b7-9976-7b029eefce81',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.430512] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1170.430784] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.430982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.431278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.431520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.431687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.431777] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.431978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.432108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.432340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.432477] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.751555] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.751883] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.752152] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.752508] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.752740] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.753124] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.753391] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.753564] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.753850] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.754057] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.754388] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.754812] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.754983] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.755269] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.755460] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.755652] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 is going to be updated. [ 1170.775758] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.776063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.776187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.776529] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.776716] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.777345] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.935224] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.935476] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.935604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.935895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.936150] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.936314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.936419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.936637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.936774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.936929] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.937165] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.937310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.937415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.937629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.937839] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.937982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.938108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.938313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.938428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.938577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.938726] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.441229] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005: rpc.has_security_group_logging(os_id): False [ 1171.449199] env[69219]: INFO networking_nsxv3.common.synchronization [req-205373ff-868e-40a0-9222-2afd61d94468 req-ac27e2b9-bcff-4993-95e4-88ef5db6d37f service nova] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1171.449386] env[69219]: INFO networking_nsxv3.common.synchronization [req-205373ff-868e-40a0-9222-2afd61d94468 req-ac27e2b9-bcff-4993-95e4-88ef5db6d37f service nova] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1171.449569] env[69219]: INFO networking_nsxv3.common.synchronization [req-205373ff-868e-40a0-9222-2afd61d94468 req-ac27e2b9-bcff-4993-95e4-88ef5db6d37f service nova] Enqueued Resource ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 with Priority: HIGHEST for action port [ 1171.449796] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_rules [ 1171.449962] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1171.450091] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 with Priority: HIGHEST for action port [ 1171.450618] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.450742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.450805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.451028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.451162] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.452036] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.452184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.452257] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.452422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.452595] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.452704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.452759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.452875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.452981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.453080] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.454031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bc79ed1-f427-48b7-9976-7b029eefce81 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.454031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.454273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.454273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.454273] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc79ed1-f427-48b7-9976-7b029eefce81',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.458932] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.459306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.459412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.459626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.459825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.460097] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.460237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.460359] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.460549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.460688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.460953] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.461205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.461205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.461384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.461490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.461745] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.461918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.462029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.462299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.462418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.462562] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1171.529551] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.529782] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.529881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.530135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.530313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.559276] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1171.955969] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.957067] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.957197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.957367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bc79ed1-f427-48b7-9976-7b029eefce81 with status ACTIVE [ 1171.957530] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.957635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.957700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.957963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.958073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.958249] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.958369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.958429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.958554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.958630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.958837] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.958932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.958990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.959146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.959220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.959303] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bc79ed1-f427-48b7-9976-7b029eefce81 is going to be updated. [ 1171.979562] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.979742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.979920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.980028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.980259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.980355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bc79ed1-f427-48b7-9976-7b029eefce81" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.105018] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 in Status: SUCCESS [ 1172.105018] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 deletion is rescheduled due to dependency. [ 1172.105018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.462147] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.966559] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.966863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.966906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.967622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.967622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.967622] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 is going to be updated. [ 1172.996530] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.996812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.996812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.998018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.998018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.006936] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: IN_PROGRESS for 2s [ 1173.045842] env[69219]: INFO networking_nsxv3.common.synchronization [req-8a5f59ef-a75c-4996-a905-5aebdf607d90 req-068f5803-ec57-49f5-90c1-0529bde93be6 tempest-AttachInterfacesV270Test-1044322912 tempest-AttachInterfacesV270Test-1044322912-project-member] Enqueued Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_members [ 1173.046556] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGHEST for action security_group_members [ 1173.046897] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.047033] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.047107] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.047646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.047646] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.047646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.047646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.047871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.047871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.047937] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.554602] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.554786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.554849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.555085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.555184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.555392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.555488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.555546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.555702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.555780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.555866] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 is going to be updated. [ 1173.588018] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1173.588018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.602849] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.602849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.602849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.602849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.603625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.612116] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 in Status: IN_PROGRESS for 2s [ 1175.018597] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: SUCCESS [ 1175.018597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.018597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.019062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.019062] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.019062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.019062] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.019213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.021071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.021071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.021071] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.524790] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.622705] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 in Status: SUCCESS [ 1175.622923] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 deletion is rescheduled due to dependency. [ 1175.623119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.026356] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8: rpc.has_security_group_logging(os_id): False [ 1176.046371] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.046537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.046612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.046833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.046926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.047206] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.047310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.047374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.047568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.047631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.047684] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 is going to be updated. [ 1176.103493] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.103676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.103719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.103973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.104086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.118386] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: IN_PROGRESS for 2s [ 1176.591443] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f69cca6b-4f1a-4ae6-b30d-e5377ad6ee0a tempest-AttachInterfacesTestJSON-527218424 tempest-AttachInterfacesTestJSON-527218424-project-member] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1176.592992] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGHEST for action security_group_members [ 1176.592992] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.592992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.592992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.592992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.592992] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.593289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.593289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.593289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.593591] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.593591] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.096016] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.096403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.096403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.096529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.096639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.096815] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.096917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.096987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.097156] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.097234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.097321] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be updated. [ 1177.123991] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.124290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.124384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.124708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.124708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.135544] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: IN_PROGRESS for 2s [ 1178.136902] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: SUCCESS [ 1178.137383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.144674] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 in Status: SUCCESS [ 1179.144962] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 deletion is rescheduled due to dependency. [ 1179.144962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.423972] env[69219]: INFO networking_nsxv3.common.synchronization [req-77c5ff1b-57a9-4ce3-827d-790343a2e8cb req-df90a0f0-5622-4e38-8510-faa6f8072488 tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_members [ 1181.424630] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_members [ 1181.424630] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.424630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.424630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.424956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.425134] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.425238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.425296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.425455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.425538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.425627] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.600051] env[69219]: INFO networking_nsxv3.common.synchronization [req-b220a981-03ea-49cb-b879-96ee9a6b976a req-29903f54-2668-412e-a96c-19278fa18fc5 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1181.600675] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1181.600999] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.601204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.601274] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.601485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.601718] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.601853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.601897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.602881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.602977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.603149] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.763255] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.763457] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.763585] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.763877] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.764193] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.764364] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.764489] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.764739] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.765103] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.765150] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.765275] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.765391] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.765513] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.765666] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1181.765798] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.765940] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.789814] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.789996] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1181.790179] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.790370] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.790719] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b5de590e-ce9b-47ff-815a-9f1ef4a28147 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.790996] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.791145] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.791471] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.791928] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5de590e-ce9b-47ff-815a-9f1ef4a28147',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.928059] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.928261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.928309] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.928518] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.928612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.928820] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.928921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.928984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.929153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.929230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.929313] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd2d154-5243-4149-a154-205541ec88ef already deleted. [ 1181.929392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.105262] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.294828] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.295156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.295310] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.295683] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.295933] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.296154] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b5de590e-ce9b-47ff-815a-9f1ef4a28147 not found, creating... [ 1182.296592] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.296769] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.296895] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.297234] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.297303] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.297615] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.297803] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.297929] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.298870] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.299359] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.299598] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b5de590e-ce9b-47ff-815a-9f1ef4a28147 is going to be created. [ 1182.325387] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.325387] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.325387] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.325387] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.325387] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.325876] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.608016] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.016114] env[69219]: INFO networking_nsxv3.common.synchronization [req-77c5ff1b-57a9-4ce3-827d-790343a2e8cb req-fb631b48-fb77-4fa8-be7a-728f86a7edbd service nova] Enqueued Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_rules [ 1183.016114] env[69219]: INFO networking_nsxv3.common.synchronization [req-77c5ff1b-57a9-4ce3-827d-790343a2e8cb req-fb631b48-fb77-4fa8-be7a-728f86a7edbd service nova] Enqueued Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_members [ 1183.016114] env[69219]: INFO networking_nsxv3.common.synchronization [req-77c5ff1b-57a9-4ce3-827d-790343a2e8cb req-fb631b48-fb77-4fa8-be7a-728f86a7edbd service nova] Enqueued Resource ID: b5de590e-ce9b-47ff-815a-9f1ef4a28147 with Priority: HIGHEST for action port [ 1183.016412] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_rules [ 1183.016584] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_members [ 1183.016637] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de590e-ce9b-47ff-815a-9f1ef4a28147 with Priority: HIGHEST for action port [ 1183.016905] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.017096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.017212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.017521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.017625] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.019812] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.019950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.020597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.021253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.021931] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.022786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.022892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.023050] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.023185] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.023396] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.024083] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5de590e-ce9b-47ff-815a-9f1ef4a28147 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.024199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.024246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.024796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.024796] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5de590e-ce9b-47ff-815a-9f1ef4a28147',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.110491] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.110721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.110721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.110921] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.111058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.111132] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1183.164102] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.164370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.164370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.164623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.164813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.175202] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1183.520608] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.520772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.526449] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.528578] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5de590e-ce9b-47ff-815a-9f1ef4a28147 with status ACTIVE [ 1183.528793] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.528969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.529172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.530824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.530944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.531165] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.531280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.531346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.537768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.537768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.537976] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.538065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.538103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.538416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.538416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.538520] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5de590e-ce9b-47ff-815a-9f1ef4a28147 is going to be updated. [ 1183.560017] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.560017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.560017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.560017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.560328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.560328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5de590e-ce9b-47ff-815a-9f1ef4a28147" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.029713] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.532268] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.532431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.532503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.532859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.533029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.533191] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd2d154-5243-4149-a154-205541ec88ef is going to be created. [ 1184.567116] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.567287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.567388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.567629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.568230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.580115] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd2d154-5243-4149-a154-205541ec88ef in Status: UNINITIALIZED for 2s [ 1185.185022] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1185.185022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.590245] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd2d154-5243-4149-a154-205541ec88ef in Status: SUCCESS [ 1186.590549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.590656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.590827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.591030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.591316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.591316] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.591436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.591436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.591568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.591684] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.095366] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.256181] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8908e6f5-626b-4a0e-bdcf-de71d020acec None None] Enqueued Resource ID: 13a4578b-11ee-4f96-a5f2-39e02c406c79 with Priority: HIGHEST for action port [ 1187.256969] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13a4578b-11ee-4f96-a5f2-39e02c406c79 with Priority: HIGHEST for action port [ 1187.257744] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-13a4578b-11ee-4f96-a5f2-39e02c406c79 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.258187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13a4578b-11ee-4f96-a5f2-39e02c406c79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.258290] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13a4578b-11ee-4f96-a5f2-39e02c406c79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.258709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13a4578b-11ee-4f96-a5f2-39e02c406c79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.258832] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13a4578b-11ee-4f96-a5f2-39e02c406c79',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.599598] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cd2d154-5243-4149-a154-205541ec88ef: rpc.has_security_group_logging(os_id): False [ 1187.617060] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.617060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.617060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.617060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.617343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.617343] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.617448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.617513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.617676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.617753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.617840] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd2d154-5243-4149-a154-205541ec88ef is going to be created. [ 1187.688992] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.688992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.688992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.688992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.688992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.700539] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cd2d154-5243-4149-a154-205541ec88ef in Status: IN_PROGRESS for 2s [ 1187.761051] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13a4578b-11ee-4f96-a5f2-39e02c406c79 [ 1187.761356] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.761516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.761649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.761899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.762095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.762143] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13a4578b-11ee-4f96-a5f2-39e02c406c79 already deleted. [ 1187.762222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13a4578b-11ee-4f96-a5f2-39e02c406c79" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.172755] env[69219]: INFO networking_nsxv3.common.synchronization [None req-8dffc9cf-12a1-4cc5-a38d-9ff648cb9c17 None None] Enqueued Resource ID: 71833943-84fb-4ca4-a1d9-d5c0f3ad7cde with Priority: HIGHEST for action port [ 1189.172755] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71833943-84fb-4ca4-a1d9-d5c0f3ad7cde with Priority: HIGHEST for action port [ 1189.172755] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-71833943-84fb-4ca4-a1d9-d5c0f3ad7cde taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.172755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71833943-84fb-4ca4-a1d9-d5c0f3ad7cde" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.172755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71833943-84fb-4ca4-a1d9-d5c0f3ad7cde" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.173345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71833943-84fb-4ca4-a1d9-d5c0f3ad7cde" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.173555] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71833943-84fb-4ca4-a1d9-d5c0f3ad7cde',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.675591] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71833943-84fb-4ca4-a1d9-d5c0f3ad7cde [ 1189.676227] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.676227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.676227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.676410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.676410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.676468] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71833943-84fb-4ca4-a1d9-d5c0f3ad7cde already deleted. [ 1189.676538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71833943-84fb-4ca4-a1d9-d5c0f3ad7cde" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.712680] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cd2d154-5243-4149-a154-205541ec88ef in Status: SUCCESS [ 1189.712911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.172825] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1194.172825] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1194.581926] env[69219]: INFO networking_nsxv3.common.synchronization [req-d3edd898-b65d-403e-9c06-31909323aabf req-c307004d-5725-4f36-8ae8-642db36a9514 tempest-ServerAddressesNegativeTestJSON-617131228 tempest-ServerAddressesNegativeTestJSON-617131228-project-member] Enqueued Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_members [ 1194.582466] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_members [ 1194.582835] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.582963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.583038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.583307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.583467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.583571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.583633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.583783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.583869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.583990] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.876063] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.876852] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-916" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.877082] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-916" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.877594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-916" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.878056] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.878500] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.878716] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.879541] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.879806] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.880113] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.880246] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.880364] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.880480] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.881129] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.881129] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.881129] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.900452] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.900874] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1194.900874] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.900996] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-916" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.901407] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.901530] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.901569] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.902183] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.902183] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('702b94ae-9eb3-402c-9dd6-822e4bbb1baf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.089205] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.089298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.089885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.089885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.090043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.091174] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.091174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.091174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.091174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.091174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.091174] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27120837-5bf8-43b5-aaeb-fabae886cbab already deleted. [ 1195.091174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.404803] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.405130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.405130] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.405520] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.405719] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.405914] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 702b94ae-9eb3-402c-9dd6-822e4bbb1baf not found, creating... [ 1195.406238] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.406408] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.406532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.406769] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.406917] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.407216] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.407378] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.407501] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.407739] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.407925] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.408133] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 702b94ae-9eb3-402c-9dd6-822e4bbb1baf is going to be created. [ 1195.427423] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.427625] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.427872] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.428224] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.428470] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.428708] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.657264] env[69219]: INFO networking_nsxv3.common.synchronization [req-396b171b-cdef-403d-ae32-6cf45975ed4d req-facac4b8-5b43-4d97-aed8-b94d730df9d9 tempest-ServersTestBootFromVolume-2130099946 tempest-ServersTestBootFromVolume-2130099946-project-member] Enqueued Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_members [ 1196.657635] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGHEST for action security_group_members [ 1196.657934] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.658074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.658140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.658336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.658486] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.658580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.658640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.659048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.659048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.659048] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.859770] env[69219]: INFO networking_nsxv3.common.synchronization [req-d3edd898-b65d-403e-9c06-31909323aabf req-4e256650-5bfe-4cb9-aaef-63abbe3710b5 service nova] Enqueued Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_rules [ 1196.860027] env[69219]: INFO networking_nsxv3.common.synchronization [req-d3edd898-b65d-403e-9c06-31909323aabf req-4e256650-5bfe-4cb9-aaef-63abbe3710b5 service nova] Enqueued Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_members [ 1196.860126] env[69219]: INFO networking_nsxv3.common.synchronization [req-d3edd898-b65d-403e-9c06-31909323aabf req-4e256650-5bfe-4cb9-aaef-63abbe3710b5 service nova] Enqueued Resource ID: 702b94ae-9eb3-402c-9dd6-822e4bbb1baf with Priority: HIGHEST for action port [ 1196.860329] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_rules [ 1196.860455] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_members [ 1196.860548] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702b94ae-9eb3-402c-9dd6-822e4bbb1baf with Priority: HIGHEST for action port [ 1196.861113] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.861235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.861350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.861549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.861719] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.862466] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.862640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.862640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.862816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.863014] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.863118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.863180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.863325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.863406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.863566] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.864323] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.868011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.868011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.868148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.868230] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('702b94ae-9eb3-402c-9dd6-822e4bbb1baf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.097211] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c6ca6e1-3f20-496d-b7be-a9677979d84b req-caa4edc0-2f78-4230-85a2-e00a77e73307 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1197.097518] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1197.097829] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.098014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.098057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.098305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.098478] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.098584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.098644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.098800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.098911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.099012] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.162080] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.162313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.162313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.162542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.162719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.162844] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.163060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.163060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.163180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.163180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.163264] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92070d36-6e2b-4078-b921-3446274e3448 is going to be updated. [ 1197.187535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.187535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.187535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.187817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.187817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.195572] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92070d36-6e2b-4078-b921-3446274e3448 in Status: IN_PROGRESS for 2s [ 1197.370550] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.370695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.370792] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.372575] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 702b94ae-9eb3-402c-9dd6-822e4bbb1baf with status ACTIVE [ 1197.372848] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.372968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.373043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.373529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.373630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.373794] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.373888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.373947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.374164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.374286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.374477] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.374566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.374623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.374770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.374900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.374900] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 702b94ae-9eb3-402c-9dd6-822e4bbb1baf is going to be updated. [ 1197.380847] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.381071] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.381311] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.381476] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.381807] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.381995] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.382172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.382413] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.382582] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.382828] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.382961] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.383100] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.383230] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.383361] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1197.383489] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.383641] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.401620] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.401852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.401940] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.402246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.402389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.403406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-702b94ae-9eb3-402c-9dd6-822e4bbb1baf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.404720] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.404912] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1197.405011] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.405196] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.405490] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-914773e9-ab74-4b21-bd7d-5775954c0d07 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.405665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.405790] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.406113] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.406259] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914773e9-ab74-4b21-bd7d-5775954c0d07',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.600827] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.873813] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.908293] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.908532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.908665] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.909074] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.909243] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.909406] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 914773e9-ab74-4b21-bd7d-5775954c0d07 not found, creating... [ 1197.909715] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.909883] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.910013] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.910247] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.910390] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.911547] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.911835] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.911978] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.912217] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.912364] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.912509] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 914773e9-ab74-4b21-bd7d-5775954c0d07 is going to be created. [ 1197.931197] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.931376] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.931503] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.931848] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.932095] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.932325] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.103311] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.376615] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.376615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.376615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.376980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.376980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.376980] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27120837-5bf8-43b5-aaeb-fabae886cbab is going to be created. [ 1198.402395] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.402559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.402559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.402818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.403028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.411260] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27120837-5bf8-43b5-aaeb-fabae886cbab in Status: UNINITIALIZED for 2s [ 1198.605636] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.605855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.605990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.606584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.606713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.606779] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1198.631191] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c6ca6e1-3f20-496d-b7be-a9677979d84b req-f805cedf-b1d7-4a19-b669-151f9688b168 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1198.631191] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c6ca6e1-3f20-496d-b7be-a9677979d84b req-f805cedf-b1d7-4a19-b669-151f9688b168 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1198.631191] env[69219]: INFO networking_nsxv3.common.synchronization [req-2c6ca6e1-3f20-496d-b7be-a9677979d84b req-f805cedf-b1d7-4a19-b669-151f9688b168 service nova] Enqueued Resource ID: 914773e9-ab74-4b21-bd7d-5775954c0d07 with Priority: HIGHEST for action port [ 1198.632298] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1198.632726] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1198.632984] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914773e9-ab74-4b21-bd7d-5775954c0d07 with Priority: HIGHEST for action port [ 1198.636018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.636018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.636018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.636018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.636018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.636018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.636018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.636018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-914773e9-ab74-4b21-bd7d-5775954c0d07 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.636018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.636018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.636018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.636018] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914773e9-ab74-4b21-bd7d-5775954c0d07',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.656114] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.658423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.658423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.658423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.658423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.671021] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1199.140544] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.140864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.140908] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 914773e9-ab74-4b21-bd7d-5775954c0d07 with status ACTIVE [ 1199.141094] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.141206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.141273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.141498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.141588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.141840] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.141939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.142025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.142179] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.142256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.142489] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.142579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.142636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.142883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.143018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.143180] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 914773e9-ab74-4b21-bd7d-5775954c0d07 is going to be updated. [ 1199.164715] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.164715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.164715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.164715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.164715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.164715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914773e9-ab74-4b21-bd7d-5775954c0d07" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.206400] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92070d36-6e2b-4078-b921-3446274e3448 in Status: SUCCESS [ 1199.206577] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92070d36-6e2b-4078-b921-3446274e3448 deletion is rescheduled due to dependency. [ 1199.206692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.420995] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27120837-5bf8-43b5-aaeb-fabae886cbab in Status: SUCCESS [ 1200.421362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.421362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.421536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.421787] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.421900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.421971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.422147] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.422229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.422313] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.422401] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.676783] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1200.677057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.677233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.677454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.677635] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.677750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.677809] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.677955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.678052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.678151] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.925752] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.925922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.926088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.926229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.926399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.926498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.926561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.926703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.926792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.926881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.927044] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.927183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.927673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.927673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.927673] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.927673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.927673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.927868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.927868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.927932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.928040] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.180031] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.430828] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 27120837-5bf8-43b5-aaeb-fabae886cbab: rpc.has_security_group_logging(os_id): False [ 1201.448547] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.448808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.448895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.449206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.449349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.449612] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.449781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.449860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.450094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.450202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.450432] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.450573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.450637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.450786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.450875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.451076] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.451170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.451288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.451364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.451434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.451516] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27120837-5bf8-43b5-aaeb-fabae886cbab is going to be created. [ 1201.528753] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.529090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.529090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.529220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.529369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.570674] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27120837-5bf8-43b5-aaeb-fabae886cbab in Status: IN_PROGRESS for 2s [ 1201.682090] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.185265] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.185568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.185568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.185774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.185863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.185985] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1202.213275] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.213467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.213572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.213728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.213878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.226147] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1202.480313] env[69219]: INFO networking_nsxv3.common.synchronization [req-a2916381-e870-49db-b255-b01bfcc84737 req-def9582c-e933-447a-83df-09e03b3153dc tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_members [ 1202.480640] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGHEST for action security_group_members [ 1202.480960] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.481216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.481216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.481381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.481535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.481632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.481700] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.481868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.482134] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.482642] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.870816] env[69219]: INFO networking_nsxv3.common.synchronization [req-0abb9aa7-d47a-42f1-8cd8-93694e3e03e5 req-5db8f02c-eede-4284-b82c-6112ea4a0c33 tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1202.870816] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1202.870816] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.870816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.870816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.870816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.870816] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.871346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.871519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.871945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.872148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.872417] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.987704] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.987704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.987704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.987704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.008013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.008933] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.009097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.009196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.009429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.009714] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.010671] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 is going to be updated. [ 1203.032973] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.033508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.033508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.034108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.034206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.042974] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 in Status: IN_PROGRESS for 2s [ 1203.375324] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.375480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.375681] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.375770] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.375861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.376078] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.376157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.376218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.376451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.376451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.376550] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1203.402911] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.403072] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.403126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.403336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.403472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.411328] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1203.583349] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 27120837-5bf8-43b5-aaeb-fabae886cbab in Status: SUCCESS [ 1203.583627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.235106] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1204.235468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.235468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.235734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.235954] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.236130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.236223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.236394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.236480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.236571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.236665] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.738978] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.739333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.739333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.739407] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.739536] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.739638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.739703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.741314] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.741314] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.741314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.741314] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.052261] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 in Status: SUCCESS [ 1205.052429] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 deletion is rescheduled due to dependency. [ 1205.052537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.244255] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605a443b-d883-4950-9fad-dd508996ac8f: rpc.has_security_group_logging(os_id): False [ 1205.261734] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.261734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.261734] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.261911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.261947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.262205] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.263211] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.263211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.263579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.263579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.263579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.263579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.263718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.263718] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1205.364407] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.364637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.364749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.365312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.365312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.381582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1205.425324] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1205.425540] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee deletion is rescheduled due to dependency. [ 1205.425724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.393915] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1207.394320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.870648] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.870778] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1210.759579] env[69219]: INFO networking_nsxv3.common.synchronization [req-9e21b804-61f7-469d-910e-76494d1c3037 req-be828970-4735-4e0f-a175-9640260d0774 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1210.760647] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1210.760647] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.760647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.760647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.760893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.761017] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.761165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.761165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.761295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.761373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.761464] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.265112] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.596615] env[69219]: INFO networking_nsxv3.common.synchronization [req-5fb1abcf-b07d-49d2-b027-d5a42031d805 req-57101f05-14c3-472d-b552-578f61a55d7e tempest-ServerAddressesNegativeTestJSON-617131228 tempest-ServerAddressesNegativeTestJSON-617131228-project-member] Enqueued Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_members [ 1211.597209] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGHEST for action security_group_members [ 1211.597431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.597557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.597624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.597822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.597972] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.598227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.598288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.598446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.598550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.598664] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.767751] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.100942] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.101132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.101207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.101454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.101552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.101798] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.101926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.101992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.102168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.102245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.102346] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27120837-5bf8-43b5-aaeb-fabae886cbab is going to be updated. [ 1212.129912] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.130101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.130202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.130350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.130485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.137976] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27120837-5bf8-43b5-aaeb-fabae886cbab in Status: IN_PROGRESS for 2s [ 1212.143787] env[69219]: INFO networking_nsxv3.common.synchronization [req-44772a0a-d3a6-432a-8b6a-2253dcc538b9 req-850ab41c-6b1d-404e-aedf-1b8d7c22b423 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1212.143787] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1212.144146] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.144505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.144505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.144646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.144827] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.145218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.145218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.145344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.145427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.145535] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.270033] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.270195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.270268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.270484] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.270574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.270679] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1212.294506] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.294619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.294708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.294885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.295045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.302639] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1212.412538] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.412771] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.412937] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.413178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.413443] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.413608] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.413728] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.413947] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.414266] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.414502] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.414622] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.415669] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.415669] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.415669] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1212.415669] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.415669] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.433252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.433415] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1212.433551] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.433726] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.434411] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.434411] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.434411] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.434648] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.434786] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d3b53cc-5cef-4fdb-9674-8d1aa26812d1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.648245] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.648429] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.648511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.648802] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.669240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.669663] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.669835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.669939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.670248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.670383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.670537] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be updated. [ 1212.698188] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.698353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.698395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.698603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.698786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.708388] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: IN_PROGRESS for 2s [ 1212.801539] env[69219]: INFO networking_nsxv3.common.synchronization [req-619d668a-6ef1-4740-aa10-5cd5241742ad req-292f5211-1dbe-45d8-b76e-c1e349aba2bf tempest-DeleteServersTestJSON-1868727971 tempest-DeleteServersTestJSON-1868727971-project-member] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1212.801995] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGHEST for action security_group_members [ 1212.802312] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.802431] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.802498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.802685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.802867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.802996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.803116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.803246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.803330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.803423] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.937526] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.937794] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.937900] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.938207] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.938705] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.938705] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 not found, creating... [ 1212.938870] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.939055] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.939403] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.939403] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.939538] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.939841] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.940020] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.940146] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.940357] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.940497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.940639] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 is going to be created. [ 1212.958554] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.958754] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.958882] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.959165] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.959392] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.959613] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.305873] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.306069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.306115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.306384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.306487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.306687] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.306808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.306895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.307084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.307199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.307250] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be updated. [ 1213.334596] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.334746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.334820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.334995] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.335157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.342847] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: IN_PROGRESS for 2s [ 1214.101645] env[69219]: INFO networking_nsxv3.common.synchronization [req-44772a0a-d3a6-432a-8b6a-2253dcc538b9 req-e082cd91-468c-4576-9dee-0396807ccdce service nova] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_rules [ 1214.101960] env[69219]: INFO networking_nsxv3.common.synchronization [req-44772a0a-d3a6-432a-8b6a-2253dcc538b9 req-e082cd91-468c-4576-9dee-0396807ccdce service nova] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1214.102071] env[69219]: INFO networking_nsxv3.common.synchronization [req-44772a0a-d3a6-432a-8b6a-2253dcc538b9 req-e082cd91-468c-4576-9dee-0396807ccdce service nova] Enqueued Resource ID: 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 with Priority: HIGHEST for action port [ 1214.102308] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_rules [ 1214.102439] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1214.102537] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 with Priority: HIGHEST for action port [ 1214.103153] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.103251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.103320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.103517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.103594] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.104724] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.104820] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.105024] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.105158] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.105193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.105345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.105414] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d3b53cc-5cef-4fdb-9674-8d1aa26812d1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.147242] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 27120837-5bf8-43b5-aaeb-fabae886cbab in Status: SUCCESS [ 1214.147456] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 27120837-5bf8-43b5-aaeb-fabae886cbab deletion is rescheduled due to dependency. [ 1214.147584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.312498] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1214.312498] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.368986] env[69219]: INFO networking_nsxv3.common.synchronization [req-b94744b4-13e7-4909-802c-9204c0ffdc9d req-d8f37f8d-0ded-4715-9258-f2aa46f2d5aa tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1214.369436] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1214.369764] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.369891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.369957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.370433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.370433] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.370433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.370675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.370675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.370675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.370776] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.607500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.607698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.607830] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 with status ACTIVE [ 1214.608045] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.608229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.608289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.608466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.608590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.608726] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.608822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.608884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.609071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.609112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.609317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.609443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.609507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.609649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.609755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.609844] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 is going to be updated. [ 1214.612472] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.612647] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.612782] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.613014] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.613267] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.613423] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.613582] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.613810] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.613955] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.614183] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.614298] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.614409] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.614521] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.614630] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.614736] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.614860] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.635975] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.636145] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.636282] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.636447] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.636783] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-e467b583-64e8-4a76-9201-e4ac22e44f93 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.636955] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.637092] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.637507] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.637580] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e467b583-64e8-4a76-9201-e4ac22e44f93',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.640502] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.640620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.640688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.640857] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.640978] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.641173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.725973] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: SUCCESS [ 1214.726174] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 deletion is rescheduled due to dependency. [ 1214.726296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.726455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.726675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.726853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.726969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.727046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.727197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.727276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.727368] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.873295] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.873466] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.873539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.873752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.873848] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.874065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.874188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.874251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.874402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.874478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.874565] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1214.897626] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.897834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.897932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.898157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.898300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.906624] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1215.139531] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.139936] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.139936] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.141686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.141686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.141686] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port e467b583-64e8-4a76-9201-e4ac22e44f93 not found, creating... [ 1215.141686] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.141686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.141686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.141686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.141686] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.141686] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.142385] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.142385] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.142385] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.142385] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.142583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: e467b583-64e8-4a76-9201-e4ac22e44f93 is going to be created. [ 1215.162255] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.162466] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.162596] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.162947] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.163219] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.163453] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.230363] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.375594] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 in Status: SUCCESS [ 1215.375990] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 deletion is rescheduled due to dependency. [ 1215.376180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.733488] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.833671] env[69219]: INFO networking_nsxv3.common.synchronization [req-b94744b4-13e7-4909-802c-9204c0ffdc9d req-0d632453-8adc-414c-84d0-aca58e7efc4d service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 1215.833865] env[69219]: INFO networking_nsxv3.common.synchronization [req-b94744b4-13e7-4909-802c-9204c0ffdc9d req-0d632453-8adc-414c-84d0-aca58e7efc4d service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1215.834019] env[69219]: INFO networking_nsxv3.common.synchronization [req-b94744b4-13e7-4909-802c-9204c0ffdc9d req-0d632453-8adc-414c-84d0-aca58e7efc4d service nova] Enqueued Resource ID: e467b583-64e8-4a76-9201-e4ac22e44f93 with Priority: HIGHEST for action port [ 1215.834262] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 1215.834387] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1215.834483] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e467b583-64e8-4a76-9201-e4ac22e44f93 with Priority: HIGHEST for action port [ 1215.835026] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.835171] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.835249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.835417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.835495] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.836476] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.836548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.836759] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e467b583-64e8-4a76-9201-e4ac22e44f93 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.836861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.836861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.837069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.837160] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e467b583-64e8-4a76-9201-e4ac22e44f93',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.236749] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.237172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.237172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.237283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.237318] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.237415] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be updated. [ 1216.267523] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.267702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.267749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.267919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.268083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.275422] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: IN_PROGRESS for 2s [ 1216.339063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.339251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.340528] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e467b583-64e8-4a76-9201-e4ac22e44f93 with status ACTIVE [ 1216.340702] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.340821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.340876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.341194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.342501] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.342501] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.342501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.342501] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e467b583-64e8-4a76-9201-e4ac22e44f93 is going to be updated. [ 1216.365525] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.365525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.365525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.365525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.365525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.365771] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.917928] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1216.917928] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee deletion is rescheduled due to dependency. [ 1216.917928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.917928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.917928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.917928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.917928] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.918469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.918469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.918469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.918469] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.420120] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.922282] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.288128] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: SUCCESS [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.288128] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.288128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.288128] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.425030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.426533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.426533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.426759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.427606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.427606] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1218.455297] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.455297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.455462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.455568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.455688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.463706] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1218.793500] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.793732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.793810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.794061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.794234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.794338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.794404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.794573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.794677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.794769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.794936] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.795051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.795136] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.795296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.795655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.795759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.795829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.796013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.796105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.796200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.796291] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.300158] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98: rpc.has_security_group_logging(os_id): False [ 1219.317246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.317447] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.317568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.317900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.318034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.318267] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.318430] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.318542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.318812] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.318956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.319280] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.319458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.319570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.319842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.319961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.320346] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.320529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.320653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.320909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.321054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.321207] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be updated. [ 1219.380242] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.380416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.380457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.380694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.380847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.394709] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: IN_PROGRESS for 2s [ 1220.473940] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1220.474232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.474327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.474495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.474671] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.474779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.474847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.474996] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.475091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.475177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.475265] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.835872] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.836090] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1220.978024] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.406714] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: SUCCESS [ 1221.406977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.481745] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39c47700-2196-4adc-afd5-b72e818055ee: rpc.has_security_group_logging(os_id): False [ 1221.502459] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.502603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.502701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.502965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.503086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.503392] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.503494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.503556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.503711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.503788] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.503894] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1221.598746] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.598746] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.599373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.599373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.599373] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.611450] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1222.538259] env[69219]: INFO networking_nsxv3.common.synchronization [req-65685b63-9e50-410e-9385-2afd1e77aafc req-68334283-3bbe-4d92-9c44-211e1bcc8579 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1222.541600] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGHEST for action security_group_members [ 1222.542063] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.542234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.542331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.542607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.543743] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.543909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.544015] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.544247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.544337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.544460] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.582793] env[69219]: INFO networking_nsxv3.common.synchronization [req-65685b63-9e50-410e-9385-2afd1e77aafc req-68334283-3bbe-4d92-9c44-211e1bcc8579 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 with Priority: HIGHEST for action port [ 1222.582793] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 with Priority: HIGHEST for action port [ 1222.582793] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.582793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.582793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.583261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.583340] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d3b53cc-5cef-4fdb-9674-8d1aa26812d1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.047417] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.047718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.047842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.048170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.048209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.048377] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.048507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.048580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.048679] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.048756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.048844] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be updated. [ 1223.074236] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.074410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.075234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.075234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.075234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.083325] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: IN_PROGRESS for 2s [ 1223.084644] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 with status ACTIVE [ 1223.084833] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.084963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.085081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.085339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.085434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.085621] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.085723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.085786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.085937] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.086026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.086236] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.086329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.086408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.086553] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.086628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.086738] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d3b53cc-5cef-4fdb-9674-8d1aa26812d1 is going to be updated. [ 1223.106138] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.106138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.106138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.106369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.106767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.106767] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d3b53cc-5cef-4fdb-9674-8d1aa26812d1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.627228] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1223.627592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.675388] env[69219]: INFO networking_nsxv3.common.synchronization [req-e760596d-7844-4794-afee-3d59ade9a0fb req-2b38c973-7c80-4a77-b65f-9492e51fcc47 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1223.675968] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1223.676825] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.676825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.676825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.677071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.679597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.679597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.679597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.679597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.679597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.679597] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.181809] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.200043] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.200043] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.200043] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.200276] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.200452] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.200624] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.200816] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.201012] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.201175] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.201389] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.201506] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.201660] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.201823] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.201997] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.202135] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.202275] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.220607] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.220796] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.221423] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.221423] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-301" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.221750] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-2481a12e-6f50-42ee-82eb-3b74cb2698f1 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.222084] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.222185] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.222653] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.222817] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2481a12e-6f50-42ee-82eb-3b74cb2698f1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.683903] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.725791] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.726017] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.726167] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.726458] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.726615] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.726773] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 2481a12e-6f50-42ee-82eb-3b74cb2698f1 not found, creating... [ 1224.727050] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.727220] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.727345] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.727569] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.727716] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.727997] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.728820] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.729021] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.729258] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.729413] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.729571] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 2481a12e-6f50-42ee-82eb-3b74cb2698f1 is going to be created. [ 1224.749458] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.749620] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.749743] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.750018] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.750262] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.750486] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.092828] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 in Status: SUCCESS [ 1225.093021] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 deletion is rescheduled due to dependency. [ 1225.093332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.187123] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.187319] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.187370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.187623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.187716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.187840] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1225.214467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.214618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.214666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.214863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.215019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.223026] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1225.435073] env[69219]: INFO networking_nsxv3.common.synchronization [req-e760596d-7844-4794-afee-3d59ade9a0fb req-08cfb066-cc8f-492d-9c0f-0a1c48e8aa35 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1225.435327] env[69219]: INFO networking_nsxv3.common.synchronization [req-e760596d-7844-4794-afee-3d59ade9a0fb req-08cfb066-cc8f-492d-9c0f-0a1c48e8aa35 service nova] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1225.435526] env[69219]: INFO networking_nsxv3.common.synchronization [req-e760596d-7844-4794-afee-3d59ade9a0fb req-08cfb066-cc8f-492d-9c0f-0a1c48e8aa35 service nova] Enqueued Resource ID: 2481a12e-6f50-42ee-82eb-3b74cb2698f1 with Priority: HIGHEST for action port [ 1225.435793] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_rules [ 1225.435986] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1225.436941] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2481a12e-6f50-42ee-82eb-3b74cb2698f1 with Priority: HIGHEST for action port [ 1225.437179] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.437233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.437358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.437630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.437785] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.438793] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.438953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.439224] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-2481a12e-6f50-42ee-82eb-3b74cb2698f1 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.439485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.439609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.440305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.440305] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2481a12e-6f50-42ee-82eb-3b74cb2698f1',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.942237] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.942670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.942670] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2481a12e-6f50-42ee-82eb-3b74cb2698f1 with status ACTIVE [ 1225.942749] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.942796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.942856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.943104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.943201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.943377] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.943478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.943539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.943698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.943774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.943951] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.944056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.944118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.944276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.944353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.944448] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2481a12e-6f50-42ee-82eb-3b74cb2698f1 is going to be updated. [ 1225.964134] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.964392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.964392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.964590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.964732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.964902] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2481a12e-6f50-42ee-82eb-3b74cb2698f1" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.233114] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1227.233114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.233537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.233537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.233630] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.233749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.233816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.233967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.234061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.234157] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.737047] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.239081] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.741586] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.741586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.741586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.742018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.742018] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.742092] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1228.767145] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.767421] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.767509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.767760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.767945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.775673] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1230.437784] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.438233] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1230.788128] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1230.788254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.788480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.788794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.789122] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.789315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.789480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.789742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.789898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.790212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.790413] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.065344] env[69219]: INFO networking_nsxv3.common.synchronization [req-34baa08e-7717-4144-9faf-654bc156a73a req-f6565776-20ef-43cf-9d24-d888dfa19892 tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1231.065344] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGHEST for action security_group_members [ 1231.065344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.065344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.065344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.065344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.065344] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.065344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.065344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.065344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.065765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.065765] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.293416] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.293656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.293656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.294870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.294870] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.294870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.294870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.294870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.294870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.294870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.294870] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.295435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.295435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.295435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.295435] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.295435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.295435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.295807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.295807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.295807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.295981] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.568158] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.568677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.568677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.568677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.568677] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.568943] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.569052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.569145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.569276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.569355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.569447] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 is going to be updated. [ 1231.621177] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.621358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.621404] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.621595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.621737] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.631355] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: IN_PROGRESS for 2s [ 1231.797918] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605a443b-d883-4950-9fad-dd508996ac8f: rpc.has_security_group_logging(os_id): False [ 1231.817805] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.817987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.818085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.818368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.818472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.818706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.818811] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.818871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.819173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.819236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.819431] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.819526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.819588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.819741] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.819872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.820071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.820167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.820223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.820364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.820440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.820521] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1231.876790] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.876790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.876790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.876790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.876790] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.889866] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1233.639581] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 in Status: SUCCESS [ 1233.639959] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 deletion is rescheduled due to dependency. [ 1233.639959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.904061] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1233.904061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.065444] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1236.065444] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.096337] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5fe3fe71-46f0-4aa0-9185-7faf23325110 tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1237.096834] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1237.097159] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.097533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.097533] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.097654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.097701] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.162356] env[69219]: INFO networking_nsxv3.common.synchronization [None req-f6d8fd45-a68b-4d1e-acbf-a9d358d348c4 tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1237.162850] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1237.163213] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.163337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.619456] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.619837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.619837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.620092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.620232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.620856] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c already deleted. [ 1237.620856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.620856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.621174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.621174] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.142571] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.142571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.142571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.142571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.142571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.142571] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c already deleted. [ 1238.142571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.334766] env[69219]: INFO networking_nsxv3.common.synchronization [req-8a8a3ee0-5d26-42b4-babd-c3989f839990 req-81035ff5-cd91-4fd5-a682-331daaf12940 tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1240.335089] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1240.335463] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.335588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.335655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.335858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.336065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.336249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.336328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.336526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.336619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.336729] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.840049] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.342371] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.844718] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.844910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.844959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.845304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.845435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.845583] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1241.876520] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.876762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.876841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.877094] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.877307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.885834] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1243.533401] env[69219]: INFO networking_nsxv3.common.synchronization [req-66f8385f-ba46-4a63-b872-dfde6d3b12e0 req-586802fc-8687-47b4-8879-364e5d54301a tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1243.534396] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1243.534731] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.534855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.534923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.535212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.535371] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.535475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.535542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.535698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.535816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.535874] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.875660] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.875879] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.875997] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.876298] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.876566] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.876736] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.876866] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.877099] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.877255] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.877472] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.877593] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1243.877708] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1243.877822] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1243.877934] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.878056] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1243.878196] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1243.893582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1243.893582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.897819] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1243.899063] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1243.899063] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1243.899063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.899063] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c2c55991-7c11-48d0-b9a8-4571675707e3 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.899063] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.899405] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.899653] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.899653] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c55991-7c11-48d0-b9a8-4571675707e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.038464] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.038703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.038703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.038968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.039081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.039319] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.039446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.039491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.039723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.039815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.039911] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c already deleted. [ 1244.040069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.403201] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.403521] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.403664] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.403987] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.404187] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.404389] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c2c55991-7c11-48d0-b9a8-4571675707e3 not found, creating... [ 1244.404674] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.404846] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.404968] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.405225] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.405481] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.405791] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.406258] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.406437] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.407335] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.407335] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.407335] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c2c55991-7c11-48d0-b9a8-4571675707e3 is going to be created. [ 1244.435761] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.435954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.435954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.436377] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.436653] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.436848] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.099520] env[69219]: INFO networking_nsxv3.common.synchronization [req-66f8385f-ba46-4a63-b872-dfde6d3b12e0 req-71d7b286-bc52-4ae9-a59a-4fb9f369ef4d service nova] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1245.100052] env[69219]: INFO networking_nsxv3.common.synchronization [req-66f8385f-ba46-4a63-b872-dfde6d3b12e0 req-71d7b286-bc52-4ae9-a59a-4fb9f369ef4d service nova] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1245.100102] env[69219]: INFO networking_nsxv3.common.synchronization [req-66f8385f-ba46-4a63-b872-dfde6d3b12e0 req-71d7b286-bc52-4ae9-a59a-4fb9f369ef4d service nova] Enqueued Resource ID: c2c55991-7c11-48d0-b9a8-4571675707e3 with Priority: HIGHEST for action port [ 1245.100816] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1245.101013] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1245.101179] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2c55991-7c11-48d0-b9a8-4571675707e3 with Priority: HIGHEST for action port [ 1245.101560] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.101748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.101834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.102123] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.102227] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.103099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.103237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.103298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.103477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.103632] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.103727] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.103787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.103971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.104118] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.104209] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.104965] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2c55991-7c11-48d0-b9a8-4571675707e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.108186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.108186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.108186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.108186] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c55991-7c11-48d0-b9a8-4571675707e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.607587] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.608743] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.608835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.610193] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2c55991-7c11-48d0-b9a8-4571675707e3 with status ACTIVE [ 1245.610394] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.611019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.611019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.611019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.611019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.611212] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.611266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.611303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.611485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.611577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.611777] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.611896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.611962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.612207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.612289] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.612401] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2c55991-7c11-48d0-b9a8-4571675707e3 is going to be updated. [ 1245.636764] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.636972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.636972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.637197] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.637334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.637493] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.114885] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.618757] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.618988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.619172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.619455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.619660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.619739] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c is going to be created. [ 1246.662497] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.662605] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.662755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.662886] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.663126] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.672877] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: UNINITIALIZED for 2s [ 1247.556515] env[69219]: INFO networking_nsxv3.common.synchronization [req-f7c2e947-39ee-477f-bbf9-5ac943f3229e req-226cc655-d403-4147-a480-8cc66a96a54f tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1247.557206] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1247.557546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.559879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.559879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.559879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.559879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.559879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.559879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.559879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.559879] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.559879] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.856421] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.856592] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.856678] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.856962] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.857247] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.857415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.857538] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.857764] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.857920] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.858393] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1247.858529] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.858645] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.858763] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.858896] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1247.859018] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.859159] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.878052] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.878220] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1247.878362] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.878544] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.878854] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-89068961-faa1-4d4e-adaf-16f48b7aa4f4 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.879204] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.879404] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.879743] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.879889] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89068961-faa1-4d4e-adaf-16f48b7aa4f4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.060657] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.382494] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.382782] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.382938] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.383264] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.383476] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.383888] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 89068961-faa1-4d4e-adaf-16f48b7aa4f4 not found, creating... [ 1248.384022] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.384175] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.384372] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.384616] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.384790] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.385209] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.385420] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.385548] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.385774] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.385944] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.386125] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 89068961-faa1-4d4e-adaf-16f48b7aa4f4 is going to be created. [ 1248.407334] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.407638] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.407794] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.408133] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.408424] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.408727] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.562803] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.683069] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: SUCCESS [ 1248.683069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.683069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.683069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.683069] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.683069] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.683548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.683548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.683548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.683548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.683548] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.065210] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.065376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.065449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.065670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.065764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.065867] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be updated. [ 1249.115193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.115441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.115441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.115612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.115866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.125927] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: IN_PROGRESS for 2s [ 1249.146191] env[69219]: INFO networking_nsxv3.common.synchronization [req-f7c2e947-39ee-477f-bbf9-5ac943f3229e req-7b83a1d7-7137-4fe4-b9f3-193164703b7e service nova] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 1249.146427] env[69219]: INFO networking_nsxv3.common.synchronization [req-f7c2e947-39ee-477f-bbf9-5ac943f3229e req-7b83a1d7-7137-4fe4-b9f3-193164703b7e service nova] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1249.146630] env[69219]: INFO networking_nsxv3.common.synchronization [req-f7c2e947-39ee-477f-bbf9-5ac943f3229e req-7b83a1d7-7137-4fe4-b9f3-193164703b7e service nova] Enqueued Resource ID: 89068961-faa1-4d4e-adaf-16f48b7aa4f4 with Priority: HIGHEST for action port [ 1249.147236] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_rules [ 1249.147456] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1249.147518] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89068961-faa1-4d4e-adaf-16f48b7aa4f4 with Priority: HIGHEST for action port [ 1249.147857] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.148041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.148041] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.148277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.148343] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.149274] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.149415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.149605] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-89068961-faa1-4d4e-adaf-16f48b7aa4f4 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.149761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.149817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.150047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.150142] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89068961-faa1-4d4e-adaf-16f48b7aa4f4',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.191030] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.259132] env[69219]: INFO networking_nsxv3.common.synchronization [req-df6b8128-9d59-42e1-ad56-c7c93f3d75bc req-fb43b136-a6a5-4291-bc21-a04215805ddb tempest-ServersTestJSON-260549327 tempest-ServersTestJSON-260549327-project-member] Enqueued Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1249.260136] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605a443b-d883-4950-9fad-dd508996ac8f with Priority: HIGHEST for action security_group_members [ 1249.260221] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-605a443b-d883-4950-9fad-dd508996ac8f taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.260330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.260400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.260611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.260768] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.261146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.261146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.261277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.261361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.261507] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605a443b-d883-4950-9fad-dd508996ac8f',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.652369] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89068961-faa1-4d4e-adaf-16f48b7aa4f4 with status ACTIVE [ 1249.652704] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.652792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.652836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.653189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.653323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.653521] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.653628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.653668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.653923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.654025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.654251] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.654384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.654529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.654761] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.654877] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.654987] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89068961-faa1-4d4e-adaf-16f48b7aa4f4 is going to be updated. [ 1249.656358] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.656358] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.675181] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.675355] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.675436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.675671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.675815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.675989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89068961-faa1-4d4e-adaf-16f48b7aa4f4" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.691610] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 766edb0e-98b8-4752-b4a4-66eb148cce1c: rpc.has_security_group_logging(os_id): False [ 1249.709365] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.709563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.709621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.709880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.710122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.710343] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.710475] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.710563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.710756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.710865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.710975] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c is going to be created. [ 1249.763910] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.764098] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.764174] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.764410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.764506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.764730] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.764838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.764901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.765150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.765256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.765332] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f is going to be updated. [ 1249.804251] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.804457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.804505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.804688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.805259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.812080] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.812080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.812080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.812080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.812080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.818139] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: IN_PROGRESS for 2s [ 1249.819090] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: IN_PROGRESS for 2s [ 1251.137089] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: SUCCESS [ 1251.137485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.137485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.137707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.137897] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.138028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.138101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.138298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.138384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.138481] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.641105] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.828528] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605a443b-d883-4950-9fad-dd508996ac8f in Status: SUCCESS [ 1251.828712] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605a443b-d883-4950-9fad-dd508996ac8f deletion is rescheduled due to dependency. [ 1251.828830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605a443b-d883-4950-9fad-dd508996ac8f" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.830703] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: SUCCESS [ 1251.830906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.143422] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.646261] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.646513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.646513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.646766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.646867] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.647028] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be updated. [ 1252.671588] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.671759] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.671815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.672073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.672226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.680480] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: IN_PROGRESS for 2s [ 1254.260716] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.261083] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1254.691387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: SUCCESS [ 1254.691634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.692513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.692513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.692513] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.692513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.692513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.692829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.692829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.692829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.692829] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.195241] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.697721] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 398e7926-33dc-450f-9584-34ddbd0ed03a: rpc.has_security_group_logging(os_id): False [ 1255.716166] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.716314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.716393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.716608] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.735823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.736133] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.736255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.736321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.736509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.736594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.736683] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be updated. [ 1255.799166] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.799333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.799333] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.799544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.799690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.810782] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: IN_PROGRESS for 2s [ 1257.825559] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: SUCCESS [ 1257.825559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.261503] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.261944] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1262.303604] env[69219]: INFO networking_nsxv3.common.synchronization [None req-e689f101-5181-431e-9c05-e64e34cb6404 None None] Enqueued Resource ID: e75192b3-8c7c-4145-8db3-19d68a6947f2 with Priority: HIGHEST for action port [ 1262.303904] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e75192b3-8c7c-4145-8db3-19d68a6947f2 with Priority: HIGHEST for action port [ 1262.304540] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e75192b3-8c7c-4145-8db3-19d68a6947f2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.304661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e75192b3-8c7c-4145-8db3-19d68a6947f2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.304721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e75192b3-8c7c-4145-8db3-19d68a6947f2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.306556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e75192b3-8c7c-4145-8db3-19d68a6947f2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.306713] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e75192b3-8c7c-4145-8db3-19d68a6947f2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.581239] env[69219]: INFO networking_nsxv3.common.synchronization [None req-1ea88152-c357-4b0d-aee9-40e579a9f787 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_rules [ 1262.581743] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_rules [ 1262.582050] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.582194] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.582273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.582529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.582611] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.667516] env[69219]: INFO networking_nsxv3.common.synchronization [None req-50c23e56-7380-47ff-bf2a-70a0d7f7165a tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_rules [ 1262.668425] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_rules [ 1262.668738] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.668843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.809412] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e75192b3-8c7c-4145-8db3-19d68a6947f2 [ 1262.809661] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.809800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.809869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.810114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.810209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.810312] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e75192b3-8c7c-4145-8db3-19d68a6947f2 already deleted. [ 1262.810395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e75192b3-8c7c-4145-8db3-19d68a6947f2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.103196] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.103361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.103410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.103610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.103699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.103796] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 already deleted. [ 1263.103882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.104043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.104204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.104291] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.627311] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.627615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.627615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.627860] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.627959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.628069] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 already deleted. [ 1263.628153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.240506] env[69219]: INFO networking_nsxv3.common.synchronization [None req-d252eb75-a9fd-431b-a2ae-794054d3af50 None None] Enqueued Resource ID: bb461f45-cd18-45c5-98c8-4078f665b7d2 with Priority: HIGHEST for action port [ 1264.240773] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb461f45-cd18-45c5-98c8-4078f665b7d2 with Priority: HIGHEST for action port [ 1264.241706] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb461f45-cd18-45c5-98c8-4078f665b7d2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.241836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb461f45-cd18-45c5-98c8-4078f665b7d2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.241897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb461f45-cd18-45c5-98c8-4078f665b7d2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.242240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb461f45-cd18-45c5-98c8-4078f665b7d2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.242326] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb461f45-cd18-45c5-98c8-4078f665b7d2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.744084] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb461f45-cd18-45c5-98c8-4078f665b7d2 [ 1264.744367] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.744458] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.744558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.744793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.744887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.744991] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb461f45-cd18-45c5-98c8-4078f665b7d2 already deleted. [ 1264.745088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb461f45-cd18-45c5-98c8-4078f665b7d2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.275141] env[69219]: INFO networking_nsxv3.common.synchronization [req-f60a3229-5563-40d4-935d-bede5685ecf8 req-3e7a9078-eb66-49f3-ace8-39aa5da7e59f tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_members [ 1268.275621] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_members [ 1268.275621] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.275723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.275764] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.275993] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.276539] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.276646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.276710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.276880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.276967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.279021] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.549202] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.549408] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.549537] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.549923] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.550454] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.550699] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.550888] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.551014] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.551162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.551458] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.551569] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1268.551638] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1268.551771] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1268.551893] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1268.552041] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1268.552293] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1268.572640] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1268.572815] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1268.572962] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1268.573162] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.573530] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b7835621-7c54-40e4-90e1-01429256b500 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.573843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.573843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.574508] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.574616] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7835621-7c54-40e4-90e1-01429256b500',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.781035] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.781270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.781270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.785025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.785025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.785025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.785025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.785025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.785025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.785025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.785025] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 already deleted. [ 1268.785025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.077331] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.077567] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.077702] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.077996] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.078182] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.078367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b7835621-7c54-40e4-90e1-01429256b500 not found, creating... [ 1269.078653] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.078855] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.078985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.079238] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.079382] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.079668] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.079838] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.079973] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.080208] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.080357] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.080560] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b7835621-7c54-40e4-90e1-01429256b500 is going to be created. [ 1269.099389] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.099590] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.099642] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.099918] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.100214] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.100516] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.794328] env[69219]: INFO networking_nsxv3.common.synchronization [req-f60a3229-5563-40d4-935d-bede5685ecf8 req-02934053-1391-4e73-a427-94fdc3db0618 service nova] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_rules [ 1269.794584] env[69219]: INFO networking_nsxv3.common.synchronization [req-f60a3229-5563-40d4-935d-bede5685ecf8 req-02934053-1391-4e73-a427-94fdc3db0618 service nova] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_members [ 1269.794669] env[69219]: INFO networking_nsxv3.common.synchronization [req-f60a3229-5563-40d4-935d-bede5685ecf8 req-02934053-1391-4e73-a427-94fdc3db0618 service nova] Enqueued Resource ID: b7835621-7c54-40e4-90e1-01429256b500 with Priority: HIGHEST for action port [ 1269.794946] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_rules [ 1269.795084] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_members [ 1269.795191] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7835621-7c54-40e4-90e1-01429256b500 with Priority: HIGHEST for action port [ 1269.795739] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.795866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.795949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.796191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.796269] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.797493] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.797609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.797675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.797840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.798009] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.798129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.798268] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.798427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.798517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.798605] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.799333] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7835621-7c54-40e4-90e1-01429256b500 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.799477] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.799619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.799672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.799722] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7835621-7c54-40e4-90e1-01429256b500',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.302342] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.302677] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.302792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.302945] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7835621-7c54-40e4-90e1-01429256b500 with status ACTIVE [ 1270.303136] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.303320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.303411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.303621] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.303715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.303894] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.304021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.304079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.304217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.304296] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.304478] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.304592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.304657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.304824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.304944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.304992] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7835621-7c54-40e4-90e1-01429256b500 is going to be updated. [ 1270.325401] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.325668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.325668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.325890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.326042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.326229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7835621-7c54-40e4-90e1-01429256b500" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.806956] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.309881] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.310182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.310182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.310390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.310488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.310595] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 is going to be created. [ 1271.334358] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.334610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.334610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.334756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.334917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.343914] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: UNINITIALIZED for 2s [ 1273.353890] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: SUCCESS [ 1273.353890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.354243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.354338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.354597] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.354773] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.354882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.355060] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.355149] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.355237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.355332] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.857481] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.360334] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9db9d77-0b95-4c7b-9735-29c3f3d86409: rpc.has_security_group_logging(os_id): False [ 1274.377092] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.377287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.377370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.377631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.377726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.377984] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.378104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.378160] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.378322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.378408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.378489] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 is going to be created. [ 1274.432579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.432837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.432837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.433026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.433218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.444611] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: IN_PROGRESS for 2s [ 1274.795846] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.795846] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1276.459307] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: SUCCESS [ 1276.459710] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.796888] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.797285] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1283.164493] env[69219]: INFO networking_nsxv3.common.synchronization [req-305686da-2c72-4b14-9879-681bf38cf815 req-679acac8-e786-4085-becd-fb3b4acf4f9f tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_members [ 1283.165017] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGHEST for action security_group_members [ 1283.165341] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.165449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.165507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.165947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.165947] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.165947] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.166173] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.166975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.166975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.169747] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.672685] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.672685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.672685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.672685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.672685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.673068] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.673068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.673068] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.673207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.673267] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.673359] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd2d154-5243-4149-a154-205541ec88ef is going to be updated. [ 1283.700319] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.700469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.700528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.700721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.700859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.708909] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd2d154-5243-4149-a154-205541ec88ef in Status: IN_PROGRESS for 2s [ 1285.719754] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cd2d154-5243-4149-a154-205541ec88ef in Status: SUCCESS [ 1285.719754] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cd2d154-5243-4149-a154-205541ec88ef deletion is rescheduled due to dependency. [ 1285.719754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.166536] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.166937] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1291.782169] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.782614] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.782614] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.782837] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.783560] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.783723] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.783849] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.784097] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.784253] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.784482] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.784600] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1291.784730] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1291.784847] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1291.784962] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.785089] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1291.785225] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1291.810175] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1291.810342] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1291.810476] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1291.810649] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-313" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.810947] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-e467b583-64e8-4a76-9201-e4ac22e44f93 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.811143] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.811273] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.811525] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.811670] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e467b583-64e8-4a76-9201-e4ac22e44f93',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.314685] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.314965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.315100] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.315292] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.315505] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.315825] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.315984] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.316118] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.316344] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.316490] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.316784] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.316941] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.317074] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.317287] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.317425] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.317570] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: e467b583-64e8-4a76-9201-e4ac22e44f93 is going to be updated. [ 1292.336507] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.336729] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.336852] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.337149] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.337360] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.337588] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.015065] env[69219]: INFO networking_nsxv3.common.synchronization [req-4e4374f6-0c85-40d6-8156-240e446f425d req-db4fcdf8-a19f-4351-9801-d412eac96dc0 service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 1293.015348] env[69219]: INFO networking_nsxv3.common.synchronization [req-4e4374f6-0c85-40d6-8156-240e446f425d req-db4fcdf8-a19f-4351-9801-d412eac96dc0 service nova] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1293.015519] env[69219]: INFO networking_nsxv3.common.synchronization [req-4e4374f6-0c85-40d6-8156-240e446f425d req-db4fcdf8-a19f-4351-9801-d412eac96dc0 service nova] Enqueued Resource ID: e467b583-64e8-4a76-9201-e4ac22e44f93 with Priority: HIGHEST for action port [ 1293.015621] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_rules [ 1293.015752] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1293.015847] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e467b583-64e8-4a76-9201-e4ac22e44f93 with Priority: HIGHEST for action port [ 1293.016402] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.016529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.016592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.016786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.016915] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.017799] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.017913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.017990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.018157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.018302] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.018394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.018470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.018603] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.018723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.018789] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.019519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-e467b583-64e8-4a76-9201-e4ac22e44f93 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.019627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.019792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.019894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.020216] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e467b583-64e8-4a76-9201-e4ac22e44f93',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.524422] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.526709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.526709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.526709] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e467b583-64e8-4a76-9201-e4ac22e44f93 with status ACTIVE [ 1293.526709] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.527124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.527124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.527124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.527286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.527399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.527565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.527565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.527665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.527753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.527879] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.528145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.528145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.528246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.528328] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.528419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e467b583-64e8-4a76-9201-e4ac22e44f93 is going to be updated. [ 1293.550644] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.550793] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.550854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.551774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.551774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.551774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e467b583-64e8-4a76-9201-e4ac22e44f93" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.030390] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.532427] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.532641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.532717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.533027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.533135] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.533241] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1294.564989] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.565261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.565261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.565416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.565538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.573624] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1296.584136] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1296.584536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.584647] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.584894] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.585126] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.585278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.585350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.585507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.585590] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.585676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.585763] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.088413] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.591164] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39c47700-2196-4adc-afd5-b72e818055ee: rpc.has_security_group_logging(os_id): False [ 1297.610585] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.610585] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.610585] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.610585] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1297.671057] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.671237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.671320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.671566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.671726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.688275] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1298.016514] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.016764] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1299.703340] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1299.703822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.017444] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.017832] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.190213] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1307.190599] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:3 started [ 1308.018875] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.019083] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1311.317022] env[69219]: INFO networking_nsxv3.common.synchronization [req-106fec5a-01af-4514-a25b-d4058e5cf294 req-20077f9b-c102-4faa-bc60-efc200ee781e tempest-ServerActionsTestOtherB-248801327 tempest-ServerActionsTestOtherB-248801327-project-member] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1311.317397] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGHEST for action security_group_members [ 1311.317726] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.317858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.317901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.318124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.318279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.318372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.318439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.318586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.318674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.318757] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.821319] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.821531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.821531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.821871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.821966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.822132] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.822237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.822293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.822508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.822596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.822685] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be updated. [ 1311.854579] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.854755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.854755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.854915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.855063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.863783] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: IN_PROGRESS for 2s [ 1313.874759] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39c47700-2196-4adc-afd5-b72e818055ee in Status: SUCCESS [ 1313.875078] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39c47700-2196-4adc-afd5-b72e818055ee deletion is rescheduled due to dependency. [ 1313.875078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.850749] env[69219]: INFO networking_nsxv3.common.synchronization [req-7636655a-607b-4833-900c-a55dc6be009c req-a082c5d2-3ad5-4d11-a9b4-fbcf1e0b8567 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1315.851313] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1315.851649] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.851769] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.851837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.852220] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.852404] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.852544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.852611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.852776] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.852885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.852972] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.250882] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.251155] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.251291] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.251562] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.251877] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.252147] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.252293] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.252549] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.252714] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.252934] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1316.253066] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1316.253190] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1316.253335] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1316.253458] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1316.253572] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1316.253708] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1316.273617] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1316.274054] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1316.274054] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1316.274194] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-296" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.274666] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c2c55991-7c11-48d0-b9a8-4571675707e3 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.274666] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.274849] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.275047] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.275162] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c55991-7c11-48d0-b9a8-4571675707e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.354962] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.777705] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.777970] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.778123] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.778420] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.778585] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.778895] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.779074] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.779200] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.779427] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.779570] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.779855] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.780026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.780151] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.780366] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.780512] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.781550] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c2c55991-7c11-48d0-b9a8-4571675707e3 is going to be updated. [ 1316.817742] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.817955] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.818099] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.818376] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.818640] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.818907] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.857402] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.359873] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.360305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.360485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.360748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.360870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.360992] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be updated. [ 1317.391673] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.391830] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.391889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.392687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.392687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.400250] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: IN_PROGRESS for 2s [ 1317.491087] env[69219]: INFO networking_nsxv3.common.synchronization [req-ab72376a-1a9a-44b3-af4a-84c2f23dd3ab req-9e327d7f-9b33-4a99-9c7e-7e88164d19f2 service nova] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1317.491301] env[69219]: INFO networking_nsxv3.common.synchronization [req-ab72376a-1a9a-44b3-af4a-84c2f23dd3ab req-9e327d7f-9b33-4a99-9c7e-7e88164d19f2 service nova] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1317.491449] env[69219]: INFO networking_nsxv3.common.synchronization [req-ab72376a-1a9a-44b3-af4a-84c2f23dd3ab req-9e327d7f-9b33-4a99-9c7e-7e88164d19f2 service nova] Enqueued Resource ID: c2c55991-7c11-48d0-b9a8-4571675707e3 with Priority: HIGHEST for action port [ 1317.494087] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_rules [ 1317.494087] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1317.494087] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2c55991-7c11-48d0-b9a8-4571675707e3 with Priority: HIGHEST for action port [ 1317.494087] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.494087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.494087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.494087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.494087] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.494950] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.494950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.494950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.494950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.494950] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.494950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.495247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.495247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.495247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.495354] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.499029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2c55991-7c11-48d0-b9a8-4571675707e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.499029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.499029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.499029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.499029] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c55991-7c11-48d0-b9a8-4571675707e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.998314] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2c55991-7c11-48d0-b9a8-4571675707e3 with status ACTIVE [ 1317.998627] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.998701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.998745] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.998961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.999061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.999243] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.999340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.999399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.999555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.999634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.999812] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.999903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.999970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.000117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.000193] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.000276] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2c55991-7c11-48d0-b9a8-4571675707e3 is going to be updated. [ 1318.001364] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.002233] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.002327] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.039155] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.039345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.039408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.039602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.039819] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.039942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2c55991-7c11-48d0-b9a8-4571675707e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.503560] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.005571] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.005889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.005889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.006064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.006155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.006250] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c is going to be updated. [ 1319.034411] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.034614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.034691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.034839] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.034980] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.044896] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: IN_PROGRESS for 2s [ 1319.410496] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: SUCCESS [ 1319.410799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.053985] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: SUCCESS [ 1321.054403] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.054570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.054826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.055141] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.055266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.055337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.055721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.055721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.055721] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.055897] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.558882] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.061968] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 766edb0e-98b8-4752-b4a4-66eb148cce1c: rpc.has_security_group_logging(os_id): False [ 1322.082974] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.082974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.082974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.082974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.082974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.082974] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.082974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.082974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.083757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.084058] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.086976] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c is going to be updated. [ 1322.143614] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.143614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.143614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.143875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.143875] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.155839] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: IN_PROGRESS for 2s [ 1322.493301] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.493485] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1323.542886] env[69219]: INFO networking_nsxv3.common.synchronization [req-bd7925aa-07ba-425e-a599-e786461ab3c8 req-59b1c1d0-eaa6-4ec9-9c03-e1ba7913b7c8 tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1323.543453] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1323.543842] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.544039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.544137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.544370] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.544535] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.544631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.544708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.545065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.545065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.545065] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.047239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.049517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.049517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.049517] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.075030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.075030] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.075030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.075030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.075030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.075030] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.075030] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1324.103293] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.103293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.103293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.103293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.103293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.111309] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1324.172577] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: SUCCESS [ 1324.172717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.702809] env[69219]: INFO networking_nsxv3.common.synchronization [None req-ca4c25e9-bcfe-4b1d-aa11-9148d76af2a7 None None] Enqueued Resource ID: 43eebd93-fe76-47d6-84d7-0a54b0edfa71 with Priority: HIGHEST for action port [ 1324.703998] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43eebd93-fe76-47d6-84d7-0a54b0edfa71 with Priority: HIGHEST for action port [ 1324.704604] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-43eebd93-fe76-47d6-84d7-0a54b0edfa71 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.705061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43eebd93-fe76-47d6-84d7-0a54b0edfa71" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.706935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43eebd93-fe76-47d6-84d7-0a54b0edfa71" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.706935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43eebd93-fe76-47d6-84d7-0a54b0edfa71" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.706935] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43eebd93-fe76-47d6-84d7-0a54b0edfa71',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.208419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43eebd93-fe76-47d6-84d7-0a54b0edfa71 [ 1325.208668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.208808] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.208883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.209127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.209219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.209315] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43eebd93-fe76-47d6-84d7-0a54b0edfa71 already deleted. [ 1325.209396] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43eebd93-fe76-47d6-84d7-0a54b0edfa71" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.120961] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1326.122105] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 deletion is rescheduled due to dependency. [ 1326.122105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.517983] env[69219]: INFO networking_nsxv3.common.synchronization [None req-fdc336bc-af0b-42bd-b3e8-0ae7dbbfc0da None None] Enqueued Resource ID: 119cf11c-52f2-4cd7-8d64-bb60669dd834 with Priority: HIGHEST for action port [ 1326.517983] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 119cf11c-52f2-4cd7-8d64-bb60669dd834 with Priority: HIGHEST for action port [ 1326.517983] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-119cf11c-52f2-4cd7-8d64-bb60669dd834 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.517983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-119cf11c-52f2-4cd7-8d64-bb60669dd834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.517983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-119cf11c-52f2-4cd7-8d64-bb60669dd834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.518354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-119cf11c-52f2-4cd7-8d64-bb60669dd834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.518354] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('119cf11c-52f2-4cd7-8d64-bb60669dd834',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.020600] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 119cf11c-52f2-4cd7-8d64-bb60669dd834 [ 1327.020813] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.020964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.021056] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.021300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.021395] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.021560] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:119cf11c-52f2-4cd7-8d64-bb60669dd834 already deleted. [ 1327.021600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-119cf11c-52f2-4cd7-8d64-bb60669dd834" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.579081] env[69219]: INFO networking_nsxv3.common.synchronization [None req-47a04322-150e-49c2-b3e8-340f27ffcee7 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_rules [ 1327.579700] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_rules [ 1327.580196] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.580381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.580612] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.580835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.582034] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.655968] env[69219]: INFO networking_nsxv3.common.synchronization [None req-2141cf51-d337-4001-aaf8-77856bc67f6a tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_rules [ 1327.656392] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_rules [ 1327.656800] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.657043] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.105760] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.105896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.105896] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.106175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.106326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.106579] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 already deleted. [ 1328.106579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.106851] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.106922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.106981] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.630228] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.630604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.630604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.630683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.630731] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.630844] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 already deleted. [ 1328.630904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.314519] env[69219]: INFO networking_nsxv3.common.synchronization [req-2815e348-e4a6-43eb-a565-b471fba3db2e req-f1623e00-6f78-4adc-9cdb-bfccc008f108 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1330.315058] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1330.315366] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.315486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.315552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.315803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.315958] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.316209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.316280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.316454] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.316540] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.316642] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.550519] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-490 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.550759] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-490" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.550898] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-490" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.551262] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-490" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.551527] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.551691] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.551814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.552150] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.552339] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.552607] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1330.552722] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1330.552836] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1330.552946] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1330.553072] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1330.553182] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1330.553313] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1330.572080] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1330.572243] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1330.572374] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1330.572572] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-490" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.572863] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.573044] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.573172] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.573468] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.573611] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9923e0cd-a8b7-4138-a10f-11dc1e93c6bf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.819014] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.819248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.819375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.819617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.819748] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.819987] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.820146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.820242] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.820467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.820583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.820705] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 already deleted. [ 1330.820821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.075673] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.076010] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.076237] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.076611] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.076858] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.077114] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf not found, creating... [ 1331.077448] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.077674] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.077827] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.078141] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.078333] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.078658] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.078866] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.079043] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.079305] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.079487] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.079667] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf is going to be created. [ 1331.098123] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.098319] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.098465] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.098819] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.098996] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.099259] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.807261] env[69219]: INFO networking_nsxv3.common.synchronization [req-2815e348-e4a6-43eb-a565-b471fba3db2e req-5e90ffa7-ed01-4e25-b425-abcc45a363ce service nova] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_rules [ 1331.807529] env[69219]: INFO networking_nsxv3.common.synchronization [req-2815e348-e4a6-43eb-a565-b471fba3db2e req-5e90ffa7-ed01-4e25-b425-abcc45a363ce service nova] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1331.807577] env[69219]: INFO networking_nsxv3.common.synchronization [req-2815e348-e4a6-43eb-a565-b471fba3db2e req-5e90ffa7-ed01-4e25-b425-abcc45a363ce service nova] Enqueued Resource ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with Priority: HIGHEST for action port [ 1331.807804] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_rules [ 1331.807933] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1331.808046] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with Priority: HIGHEST for action port [ 1331.808593] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.808711] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.808779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.809223] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.809298] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.810100] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.810218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.810282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.810460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.810601] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.810693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.810756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.810890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.811125] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.811125] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.811774] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.811881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.811950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.812109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.812179] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9923e0cd-a8b7-4138-a10f-11dc1e93c6bf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.313411] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.314514] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.314650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.318119] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with status ACTIVE [ 1332.318305] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.318451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.318527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.318717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.318806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.318975] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.319093] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.319158] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.319294] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.319368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.319546] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.319637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.319685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.319823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.319898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.319990] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf is going to be updated. [ 1332.341672] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.341838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.341910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.342128] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.342303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.342532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.815789] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.318924] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.319131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.319131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.319459] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.319523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.319587] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be created. [ 1333.342021] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.342202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.342278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.342492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.342674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.351156] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: UNINITIALIZED for 2s [ 1334.188795] env[69219]: INFO networking_nsxv3.common.synchronization [req-ca4bba0d-68ed-4e6d-9605-85b084883ba2 req-4a0317b5-9239-48d2-9910-a2bfcf792487 tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1334.189312] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1334.189635] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.189795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.189885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.190106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.190270] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.190371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.190428] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.191496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.191496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.191496] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.530742] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.530971] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.531120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.531406] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.531676] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.531842] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.531965] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.532390] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.532552] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.532826] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1334.532950] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1334.533080] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1334.533197] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1334.534109] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1334.534109] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1334.534109] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1334.553168] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1334.553168] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1334.553168] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1334.553168] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.553168] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-3d7be741-2608-4479-987e-b3fdf8f460c0 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.553428] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.553532] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.553916] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.554155] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d7be741-2608-4479-987e-b3fdf8f460c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.694459] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.694642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.694687] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.695038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.695206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.695451] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.695587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.695673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.695855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.695956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.696086] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1334.725168] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.725307] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.725351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.725580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.725744] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.733677] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1335.056448] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.056673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.056805] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.057105] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.057264] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.057493] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 3d7be741-2608-4479-987e-b3fdf8f460c0 not found, creating... [ 1335.057831] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.057983] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.058149] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.058431] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.058626] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.058961] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.059168] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.059306] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.059583] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.059739] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.059881] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 3d7be741-2608-4479-987e-b3fdf8f460c0 is going to be created. [ 1335.079392] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.079604] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.079766] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.080120] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.080582] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.080750] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.361784] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1335.362119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.362170] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.362366] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.362549] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.362680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.362743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.362899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.362981] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.363077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.363193] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.831106] env[69219]: INFO networking_nsxv3.common.synchronization [req-ca4bba0d-68ed-4e6d-9605-85b084883ba2 req-d9298a64-f537-49bd-8df4-b5d9a05ce69f service nova] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 1335.831322] env[69219]: INFO networking_nsxv3.common.synchronization [req-ca4bba0d-68ed-4e6d-9605-85b084883ba2 req-d9298a64-f537-49bd-8df4-b5d9a05ce69f service nova] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1335.831475] env[69219]: INFO networking_nsxv3.common.synchronization [req-ca4bba0d-68ed-4e6d-9605-85b084883ba2 req-d9298a64-f537-49bd-8df4-b5d9a05ce69f service nova] Enqueued Resource ID: 3d7be741-2608-4479-987e-b3fdf8f460c0 with Priority: HIGHEST for action port [ 1335.831717] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 1335.831845] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1335.831926] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d7be741-2608-4479-987e-b3fdf8f460c0 with Priority: HIGHEST for action port [ 1335.832531] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.832697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.832780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.832994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.833208] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.834133] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.834308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.834542] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d7be741-2608-4479-987e-b3fdf8f460c0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.834690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.834863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.835013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.835129] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d7be741-2608-4479-987e-b3fdf8f460c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.865877] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.866418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.866572] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.866823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.867043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.867167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.867233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.867406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.867503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.867588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.867740] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.867831] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.867892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.868045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.868185] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.868275] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.868331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.868467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.868539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.868620] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.868708] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.149934] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.151287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.151287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.151287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.151287] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.337077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.337258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.337421] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d7be741-2608-4479-987e-b3fdf8f460c0 with status ACTIVE [ 1336.337594] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.337702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.337766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.337979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.338088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.338256] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.338350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.338414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.338569] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.338640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.338844] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.338938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.338999] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.339142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.339215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.339372] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d7be741-2608-4479-987e-b3fdf8f460c0 is going to be updated. [ 1336.359031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.359031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.359031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.359379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.359379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.359583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d7be741-2608-4479-987e-b3fdf8f460c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.370940] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dd4b0d4-c0ca-44d2-828d-4a60b306b263: rpc.has_security_group_logging(os_id): False [ 1336.394962] env[69219]: INFO networking_nsxv3.common.synchronization [req-4345427a-e41d-4267-980c-194e93d77674 req-1f0575c0-547c-4252-8aa1-1c2decb5442c tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_members [ 1336.395517] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_members [ 1336.395825] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.395950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.396027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.396391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.396548] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.396654] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.396707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.396863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.396942] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.397081] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.403462] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.403626] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.403738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.403967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.404085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.404382] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.404531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.404606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.404813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.404945] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.405912] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.405912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.405912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.405912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.405912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.406270] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.406270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.406270] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.406457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.406528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.406588] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be created. [ 1336.476606] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.476775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.476825] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.477019] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.477215] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.503863] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: IN_PROGRESS for 2s [ 1336.653015] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.710241] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.710511] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.710690] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.711030] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.711382] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.711594] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.711784] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.712219] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.712350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.712686] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1336.712877] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1336.713076] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1336.713247] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1336.713379] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1336.713533] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1336.713714] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1336.736842] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1336.736980] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1336.737128] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1336.737311] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.737627] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-b455cc55-bef0-4963-a7d5-7bb5cb949b92 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.737805] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.737928] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.738274] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.738418] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b455cc55-bef0-4963-a7d5-7bb5cb949b92',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.753254] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1336.753422] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 deletion is rescheduled due to dependency. [ 1336.753534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.753967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.754200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.754382] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.754499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.754565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.754722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.754803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.754893] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.899474] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.899630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.899680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.899903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.899998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.900204] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.900306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.900369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.900539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.900638] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.900731] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 already deleted. [ 1336.900841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.155709] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.241181] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.241415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.241561] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.241835] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.241998] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.242177] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port b455cc55-bef0-4963-a7d5-7bb5cb949b92 not found, creating... [ 1337.242445] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.242643] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.242779] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.242999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.243159] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.243443] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.243615] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.243746] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.243981] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.244117] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.244262] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: b455cc55-bef0-4963-a7d5-7bb5cb949b92 is going to be created. [ 1337.257165] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.264071] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.264292] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.264428] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.264797] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.265062] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.265301] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.540564] env[69219]: INFO networking_nsxv3.common.synchronization [req-95430423-4228-4447-b9a8-74daa818b22a req-ae88e0a8-c5cd-4449-8950-ce5dd7c9a442 tempest-ServerActionsTestOtherA-805397603 tempest-ServerActionsTestOtherA-805397603-project-member] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1337.541109] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGHEST for action security_group_members [ 1337.541453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.541595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.541671] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.541930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.542123] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.542261] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.542336] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.542483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.542562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.542686] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.657515] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1337.657666] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1337.759389] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.044988] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.047821] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.047821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.047821] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be updated. [ 1338.072454] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.074511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.074511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.074511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.074511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.082311] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: IN_PROGRESS for 2s [ 1338.264209] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.264209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.264209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.264209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.264209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.264209] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1338.293729] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.293729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.293729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.293729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.293729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.301163] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1338.317220] env[69219]: INFO networking_nsxv3.common.synchronization [req-4345427a-e41d-4267-980c-194e93d77674 req-4986fecc-7cd0-4098-bcae-306fe9aa4765 service nova] Enqueued Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_rules [ 1338.317220] env[69219]: INFO networking_nsxv3.common.synchronization [req-4345427a-e41d-4267-980c-194e93d77674 req-4986fecc-7cd0-4098-bcae-306fe9aa4765 service nova] Enqueued Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_members [ 1338.317220] env[69219]: INFO networking_nsxv3.common.synchronization [req-4345427a-e41d-4267-980c-194e93d77674 req-4986fecc-7cd0-4098-bcae-306fe9aa4765 service nova] Enqueued Resource ID: b455cc55-bef0-4963-a7d5-7bb5cb949b92 with Priority: HIGHEST for action port [ 1338.317220] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_rules [ 1338.317220] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_members [ 1338.317220] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b455cc55-bef0-4963-a7d5-7bb5cb949b92 with Priority: HIGHEST for action port [ 1338.318406] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.318998] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.319292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.319604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.319800] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.321379] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.321709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.321868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.322250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.322601] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.325641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.325641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.325641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.325641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.325641] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.325641] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-b455cc55-bef0-4963-a7d5-7bb5cb949b92 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.325641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.325641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.325641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.325641] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b455cc55-bef0-4963-a7d5-7bb5cb949b92',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.514366] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1338.514625] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.539451] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.539685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.539685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.539967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.553840] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1338.554668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.555520] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1338.592418] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.592650] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.592743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.592988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.606500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.607302] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1338.607376] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1338.607474] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1338.648106] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.648304] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.648374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.648579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.649889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.650101] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1338.746144] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.746386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.746386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.746578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.746904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.747224] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1338.825713] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.825931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.825931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.826095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.826419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.826822] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1338.826913] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'27120837-5bf8-43b5-aaeb-fabae886cbab', '39e3a8ce-a00d-4a24-8049-ab1615d53479', '6ca12f68-e96e-40a5-86d0-c5aa6f465be8', '4620fe61-858f-4c22-8abc-d5f135e99e49', '03b383a8-62e8-454b-9d3c-ac3de2f9ba05', 'cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8', '6dff8bb9-b284-4a8b-9460-b9a3acdd7c30', '7cd2d154-5243-4149-a154-205541ec88ef', '66dbd3fd-dcc5-433c-8ce2-c27a2f44d005', '766edb0e-98b8-4752-b4a4-66eb148cce1c', 'eb30b358-da7b-4abc-ac4d-7b6b8baeed61', 'ec5e6bce-48d8-4a26-8add-53a08d2b2afe', 'e9db9d77-0b95-4c7b-9735-29c3f3d86409', '2f8662e1-7633-4a32-9aae-91c642b75dd8', 'bcba48ed-3f96-4cef-8edf-50ba05bacea8', 'ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43', 'c06b0f72-9b10-4089-a399-981c25e289e8', '92070d36-6e2b-4078-b921-3446274e3448', '3afd8a02-3b29-4be8-aae2-a4f15df4f234', '9153ebdf-4f47-4818-bdd9-2172ee701c16', 'ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d', 'd5e5bd65-43e8-43dd-ba51-515caef2f24d', 'df327ac5-73cd-478c-b19b-3849894e070d', '04ba1205-02a7-4968-99ca-25d19305f8e9', '49f615d4-07b5-4c31-a7c9-afa72b7059c0', 'bfae446e-9362-456c-b5ff-375627350736', '398e7926-33dc-450f-9584-34ddbd0ed03a', '0687614d-5fbe-486f-942e-47e8dcdc82e2', '7fdacd70-c14b-4dd0-9cba-de8872db32ca', 'ba38a24c-584a-4fc2-8fc4-91929e372e75', 'ee58207b-f6f5-4d2a-b0d7-fb2dc440c630', '39c47700-2196-4adc-afd5-b72e818055ee', '55b28f2a-86c9-4b72-a2dc-7c308af8d9e3', 'd679379b-ec68-4cf7-8ccd-4f2d4d8b12dd', '0d7564b1-7081-4c22-95c9-b5c511c04590', '50a3720b-a5ee-456e-b60f-4ae4d9b5fe98', '9fd497c4-079b-43cf-9489-d33299e4d9c7', '605a443b-d883-4950-9fad-dd508996ac8f', '1e06ed06-d558-4f57-8586-39a8c2f2a293', 'fd4746a8-624d-411a-b8a7-b5c965021a51', '2dd4b0d4-c0ca-44d2-828d-4a60b306b263'} {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1338.827044] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1338.828136] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.828286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.828386] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b455cc55-bef0-4963-a7d5-7bb5cb949b92 with status ACTIVE [ 1338.828559] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.828664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.828717] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.828887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.828974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.829136] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.829217] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.829326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.829460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.829537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.829708] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.829810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.829862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.829982] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.830064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.830145] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b455cc55-bef0-4963-a7d5-7bb5cb949b92 is going to be updated. [ 1338.831131] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.850875] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.850997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.851053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.851226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.851343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.851480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b455cc55-bef0-4963-a7d5-7bb5cb949b92" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.852231] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.852337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.852409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.852558] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.852686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.852788] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1338.852859] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1338.852927] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1338.921238] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.921472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.921472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.921674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.922898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.923203] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1338.923306] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1338.923384] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1338.923455] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1338.923560] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1338.923639] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGH for action security_group_rules [ 1338.923734] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGH for action security_group_rules [ 1338.923845] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGH for action security_group_rules [ 1338.923883] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGH for action security_group_rules [ 1338.923958] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGH for action security_group_rules [ 1338.924029] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGH for action security_group_rules [ 1338.924109] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGH for action security_group_rules [ 1338.924173] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGH for action security_group_rules [ 1338.924230] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGH for action security_group_rules [ 1338.924314] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGH for action security_group_rules [ 1338.924374] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGH for action security_group_rules [ 1338.924430] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGH for action security_group_rules [ 1338.924509] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGH for action security_group_rules [ 1338.924586] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGH for action security_group_rules [ 1338.924645] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGH for action security_group_rules [ 1338.924721] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGH for action security_group_rules [ 1338.924801] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGH for action security_group_rules [ 1338.924864] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGH for action security_group_rules [ 1338.924929] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGH for action security_group_rules [ 1338.925027] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGH for action security_group_rules [ 1338.925131] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.334362] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.837245] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.837792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.837792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.837792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.837792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.837938] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 is going to be created. [ 1339.859608] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.859853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.859853] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.860138] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.860314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.869459] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab663a3-0671-4475-a619-1f23fb7b27a0 in Status: UNINITIALIZED for 2s [ 1340.093242] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 398e7926-33dc-450f-9584-34ddbd0ed03a in Status: SUCCESS [ 1340.093522] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a deletion is rescheduled due to dependency. [ 1340.093628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.311157] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1340.311379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.311545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.311774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.311971] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.312103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.312168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.312331] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.312416] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.312516] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.312844] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.815016] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.318370] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fd497c4-079b-43cf-9489-d33299e4d9c7: rpc.has_security_group_logging(os_id): False [ 1341.336143] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.336375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.336375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.336587] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.357377] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.357668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.357797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.357858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.358073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.358157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.358251] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1341.414453] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.414694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.414694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.414863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.415014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.425841] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1341.879096] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab663a3-0671-4475-a619-1f23fb7b27a0 in Status: SUCCESS [ 1341.879357] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.879566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.879842] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.880207] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.880339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.880410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.880850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.880850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.880850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.880966] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.383584] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.886286] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bab663a3-0671-4475-a619-1f23fb7b27a0: rpc.has_security_group_logging(os_id): False [ 1342.903772] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.903989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.903989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.904212] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.904301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.904856] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.905013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.905087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.905254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.905334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.905425] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 is going to be created. [ 1342.960680] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.960876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.960876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.961101] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.961279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.973999] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bab663a3-0671-4475-a619-1f23fb7b27a0 in Status: IN_PROGRESS for 2s [ 1343.317919] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.318091] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1343.318206] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27120837-5bf8-43b5-aaeb-fabae886cbab with Priority: HIGH for action security_group_rules [ 1343.318353] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 with Priority: HIGH for action security_group_rules [ 1343.318892] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 with Priority: HIGH for action security_group_rules [ 1343.319115] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 with Priority: HIGH for action security_group_rules [ 1343.319261] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 with Priority: HIGH for action security_group_rules [ 1343.319366] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 with Priority: HIGH for action security_group_rules [ 1343.319481] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92070d36-6e2b-4078-b921-3446274e3448 with Priority: HIGH for action security_group_rules [ 1343.319586] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06b0f72-9b10-4089-a399-981c25e289e8 with Priority: HIGH for action security_group_rules [ 1343.319696] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 with Priority: HIGH for action security_group_rules [ 1343.319798] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 with Priority: HIGH for action security_group_rules [ 1343.319900] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGH for action security_group_rules [ 1343.320007] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe with Priority: HIGH for action security_group_rules [ 1343.320115] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 with Priority: HIGH for action security_group_rules [ 1343.320205] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGH for action security_group_rules [ 1343.320295] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 with Priority: HIGH for action security_group_rules [ 1343.320384] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 with Priority: HIGH for action security_group_rules [ 1343.320472] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cd2d154-5243-4149-a154-205541ec88ef with Priority: HIGH for action security_group_rules [ 1343.320560] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 with Priority: HIGH for action security_group_rules [ 1343.320665] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 with Priority: HIGH for action security_group_rules [ 1343.320775] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 with Priority: HIGH for action security_group_rules [ 1343.321445] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-27120837-5bf8-43b5-aaeb-fabae886cbab taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.321583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.321653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.322634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.322634] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('27120837-5bf8-43b5-aaeb-fabae886cbab',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.322932] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.323097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.323162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.323291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.323433] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ca12f68-e96e-40a5-86d0-c5aa6f465be8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.324199] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.324312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.324379] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.324531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.324604] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dff8bb9-b284-4a8b-9460-b9a3acdd7c30',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.326086] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.326211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.326258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.326412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.326486] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcba48ed-3f96-4cef-8edf-50ba05bacea8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.327419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9153ebdf-4f47-4818-bdd9-2172ee701c16 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.327557] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.327611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.327765] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.328119] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9153ebdf-4f47-4818-bdd9-2172ee701c16',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.328966] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.328966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.328966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.329385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.329449] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3afd8a02-3b29-4be8-aae2-a4f15df4f234',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.330108] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92070d36-6e2b-4078-b921-3446274e3448 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.330277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.330277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.330589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.330589] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92070d36-6e2b-4078-b921-3446274e3448',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.331457] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06b0f72-9b10-4089-a399-981c25e289e8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.331457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.331457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.331645] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.331645] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06b0f72-9b10-4089-a399-981c25e289e8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.332325] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f8662e1-7633-4a32-9aae-91c642b75dd8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.332427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.332480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.332696] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.332743] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f8662e1-7633-4a32-9aae-91c642b75dd8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.333423] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.333529] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.333595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.333760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.333838] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.334516] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.334618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.334684] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.334834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.334908] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.335668] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.335852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.335852] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.335991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.336058] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec5e6bce-48d8-4a26-8add-53a08d2b2afe',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.336707] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.336815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.336922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.337039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.337112] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb30b358-da7b-4abc-ac4d-7b6b8baeed61',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.337777] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.337881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.337946] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.338108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.338178] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.338914] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.339089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.339089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.339253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.339324] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66dbd3fd-dcc5-433c-8ce2-c27a2f44d005',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.340029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.340088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.340151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.340303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.340374] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.341080] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cd2d154-5243-4149-a154-205541ec88ef taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.341186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.341251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.341400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.341469] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cd2d154-5243-4149-a154-205541ec88ef',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.342136] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.342246] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.342303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.342457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.342514] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03b383a8-62e8-454b-9d3c-ac3de2f9ba05',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.344589] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39e3a8ce-a00d-4a24-8049-ab1615d53479 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.344720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.344797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.344983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.345120] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39e3a8ce-a00d-4a24-8049-ab1615d53479',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.345776] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4620fe61-858f-4c22-8abc-d5f135e99e49 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.345924] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.345973] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.346165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.346248] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4620fe61-858f-4c22-8abc-d5f135e99e49',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.441971] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1343.441971] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.845108] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.845339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.845441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.845756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.847203] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.847310] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.847381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.847552] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.847705] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.847804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.847868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.848010] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.848103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.848189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.848274] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.856397] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.856528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.856589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.856840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.857100] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.857100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.857238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.857291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.857451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.857451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.857585] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.866017] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.875091] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 766edb0e-98b8-4752-b4a4-66eb148cce1c: rpc.has_security_group_logging(os_id): False [ 1343.876905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.877254] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dff8bb9-b284-4a8b-9460-b9a3acdd7c30 is going to be deleted. [ 1343.913028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.913028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.913028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.913314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.920345] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.920499] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.921374] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.921495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.922530] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.922686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.927025] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.927152] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.928603] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.928723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.930773] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.930884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.931608] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.931723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.932437] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.932547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.933292] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.933385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.934114] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.934219] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.935026] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.935187] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.935279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.936273] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.936655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.936749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.937335] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.937792] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.937870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.938485] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.938869] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.938957] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.939577] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.939984] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.940088] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.941506] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.941946] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.942034] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.942689] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.943077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.943168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.954245] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1343.954965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.955165] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06b0f72-9b10-4089-a399-981c25e289e8 is going to be deleted. [ 1343.956105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.956308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.975369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.975495] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43 is going to be deleted. [ 1343.976314] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.976522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.986375] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.986509] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.992868] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.992976] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03b383a8-62e8-454b-9d3c-ac3de2f9ba05 is going to be deleted. [ 1343.993785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.994159] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.012364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.012493] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcba48ed-3f96-4cef-8edf-50ba05bacea8 is going to be deleted. [ 1344.013391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.013602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.015028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.015143] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.039265] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.039265] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cd2d154-5243-4149-a154-205541ec88ef is going to be deleted. [ 1344.040501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.040730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.045271] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.045385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.085217] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.085492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.086546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.086711] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9153ebdf-4f47-4818-bdd9-2172ee701c16 is going to be deleted. [ 1344.087900] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.088208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.128316] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.128500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.165320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.165581] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66dbd3fd-dcc5-433c-8ce2-c27a2f44d005 is going to be deleted. [ 1344.166633] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.166840] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.184577] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.184577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.220348] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.220485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.224321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.224537] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92070d36-6e2b-4078-b921-3446274e3448 is going to be deleted. [ 1344.225339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.225545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.264520] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.264654] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb30b358-da7b-4abc-ac4d-7b6b8baeed61 is going to be deleted. [ 1344.265653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.265949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.321102] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.321286] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.322483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.322606] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 27120837-5bf8-43b5-aaeb-fabae886cbab is going to be deleted. [ 1344.323586] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.323817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.343503] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.343616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.369076] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.383369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.383486] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8 is going to be deleted. [ 1344.384351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.384560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.404764] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.404885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.434188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.434641] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.434816] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.434972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.435276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.435426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.435794] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c is going to be updated. [ 1344.437172] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.437438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.439418] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.439524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.481049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.481376] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4620fe61-858f-4c22-8abc-d5f135e99e49 is going to be deleted. [ 1344.482028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.482236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.503381] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.503568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.530691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.530841] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ca12f68-e96e-40a5-86d0-c5aa6f465be8 is going to be deleted. [ 1344.531757] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.531970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.556210] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.556393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.572048] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.572180] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39e3a8ce-a00d-4a24-8049-ab1615d53479 is going to be deleted. [ 1344.573025] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.573238] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.639693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.639871] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec5e6bce-48d8-4a26-8add-53a08d2b2afe is going to be deleted. [ 1344.640785] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.641009] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.643397] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.643523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.677566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.677690] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3afd8a02-3b29-4be8-aae2-a4f15df4f234 is going to be deleted. [ 1344.678571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.678818] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.678926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.679077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dff8bb9-b284-4a8b-9460-b9a3acdd7c30" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.679229] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.679389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.679461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.679579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06b0f72-9b10-4089-a399-981c25e289e8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.680035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.680201] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.680284] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.680393] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebfc4b78-fbbf-402b-bfd2-6d8088dbfc43" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.680524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.680695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.680781] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.680876] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03b383a8-62e8-454b-9d3c-ac3de2f9ba05" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.681022] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.681169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.681250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.681344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcba48ed-3f96-4cef-8edf-50ba05bacea8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.681465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.681792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.681792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.681792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cd2d154-5243-4149-a154-205541ec88ef" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.682035] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.682108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.682175] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.682239] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9153ebdf-4f47-4818-bdd9-2172ee701c16" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.682367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.682505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.682574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.682750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66dbd3fd-dcc5-433c-8ce2-c27a2f44d005" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.682909] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.683330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.683330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.683330] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92070d36-6e2b-4078-b921-3446274e3448" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.683559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.683559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.683682] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.683804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb30b358-da7b-4abc-ac4d-7b6b8baeed61" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.683927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.684081] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.718334] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.718522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.731874] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.732035] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f8662e1-7633-4a32-9aae-91c642b75dd8 is going to be deleted. [ 1344.732955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.733180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.733264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.733386] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-27120837-5bf8-43b5-aaeb-fabae886cbab" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.733542] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.733723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.733837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.733966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf26b45f-5fe7-4ef2-98f7-6e46e3061ca8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.734488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.734656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.734800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.735754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.735922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.736014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.736142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4620fe61-858f-4c22-8abc-d5f135e99e49" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.736276] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.736423] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.736501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.736614] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ca12f68-e96e-40a5-86d0-c5aa6f465be8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.768715] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.768881] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.768966] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.769144] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.769241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.769408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39e3a8ce-a00d-4a24-8049-ab1615d53479" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.802547] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: IN_PROGRESS for 2s [ 1344.812958] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.813142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.813209] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.813414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.813505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.813651] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec5e6bce-48d8-4a26-8add-53a08d2b2afe" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.871199] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9db9d77-0b95-4c7b-9735-29c3f3d86409: rpc.has_security_group_logging(os_id): False [ 1344.886096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.886342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.886342] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.886610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.886743] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.886863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3afd8a02-3b29-4be8-aae2-a4f15df4f234" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.887720] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.887865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.887969] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.888187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.888282] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.888422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f8662e1-7633-4a32-9aae-91c642b75dd8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.895295] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1344.895853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.895964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.896183] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.896320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.931685] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.932139] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.932139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.932139] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.932433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.932527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.932618] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 is going to be updated. [ 1344.996226] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bab663a3-0671-4475-a619-1f23fb7b27a0 in Status: SUCCESS [ 1344.998232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.068742] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.068742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.068742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.068742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.068742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.091142] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: IN_PROGRESS for 2s [ 1345.791739] env[69219]: INFO networking_nsxv3.common.synchronization [None req-a22d03c5-0de4-41ab-bddc-7ce659adf407 None None] Enqueued Resource ID: 84061462-c5c3-4565-8c17-4e4665f187e3 with Priority: HIGHEST for action port [ 1345.791739] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84061462-c5c3-4565-8c17-4e4665f187e3 with Priority: HIGHEST for action port [ 1345.791739] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-84061462-c5c3-4565-8c17-4e4665f187e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.791739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84061462-c5c3-4565-8c17-4e4665f187e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.791739] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84061462-c5c3-4565-8c17-4e4665f187e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.792611] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84061462-c5c3-4565-8c17-4e4665f187e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.792857] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84061462-c5c3-4565-8c17-4e4665f187e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.296339] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84061462-c5c3-4565-8c17-4e4665f187e3 [ 1346.296339] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.296339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.296339] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.296541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.296541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.296629] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84061462-c5c3-4565-8c17-4e4665f187e3 already deleted. [ 1346.296707] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84061462-c5c3-4565-8c17-4e4665f187e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.564883] env[69219]: INFO networking_nsxv3.common.synchronization [None req-1330da5d-6912-4ed2-a3cd-9c1cc617ca6c tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_rules [ 1346.566609] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_rules [ 1346.567229] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.567488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.567488] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.567683] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.567766] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.733365] env[69219]: INFO networking_nsxv3.common.synchronization [None req-04ed0c12-2c79-4c47-97f9-c867c2792a16 tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_rules [ 1346.733967] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_rules [ 1346.734804] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.734910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.826323] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: SUCCESS [ 1346.827078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.093983] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.093983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.093983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.093983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.093983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.093983] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc already deleted. [ 1347.093983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.094455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.094722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.094896] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.105930] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: SUCCESS [ 1347.106885] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.618898] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.619348] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.619704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.620402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.620402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.620402] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc already deleted. [ 1347.620402] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.988108] env[69219]: INFO networking_nsxv3.common.synchronization [None req-a84b2acf-d3c2-4e58-8060-4ac82a240fa4 None None] Enqueued Resource ID: afd8b935-8f55-4345-84df-aa7eb4942ba3 with Priority: HIGHEST for action port [ 1347.988108] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd8b935-8f55-4345-84df-aa7eb4942ba3 with Priority: HIGHEST for action port [ 1347.988108] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-afd8b935-8f55-4345-84df-aa7eb4942ba3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.988108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afd8b935-8f55-4345-84df-aa7eb4942ba3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.988108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afd8b935-8f55-4345-84df-aa7eb4942ba3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.988850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afd8b935-8f55-4345-84df-aa7eb4942ba3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.988850] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afd8b935-8f55-4345-84df-aa7eb4942ba3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.491946] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afd8b935-8f55-4345-84df-aa7eb4942ba3 [ 1348.492193] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.492292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.492353] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.492578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.492722] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.492841] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afd8b935-8f55-4345-84df-aa7eb4942ba3 already deleted. [ 1348.492931] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afd8b935-8f55-4345-84df-aa7eb4942ba3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.066857] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f3d218f-5e80-4c3b-baa8-749119fde340 req-69e41ca8-8509-48fc-be03-25370b2c0820 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_members [ 1350.067168] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f3d218f-5e80-4c3b-baa8-749119fde340 req-69e41ca8-8509-48fc-be03-25370b2c0820 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.068171] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_members [ 1350.068171] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.068171] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87a32d8-f65d-4509-b087-c9a87aa3942d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.068369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.068369] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.068583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.068736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.068835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.068898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.069165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.069165] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.069276] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.070488] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.070592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.070674] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.070813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.070956] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.071061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.071124] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.071266] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.071347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.071432] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.108008] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f3d218f-5e80-4c3b-baa8-749119fde340 req-69e41ca8-8509-48fc-be03-25370b2c0820 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_rules [ 1350.108216] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f3d218f-5e80-4c3b-baa8-749119fde340 req-69e41ca8-8509-48fc-be03-25370b2c0820 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.108363] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f3d218f-5e80-4c3b-baa8-749119fde340 req-69e41ca8-8509-48fc-be03-25370b2c0820 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_rules [ 1350.108498] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f3d218f-5e80-4c3b-baa8-749119fde340 req-69e41ca8-8509-48fc-be03-25370b2c0820 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_members [ 1350.108633] env[69219]: INFO networking_nsxv3.common.synchronization [req-3f3d218f-5e80-4c3b-baa8-749119fde340 req-69e41ca8-8509-48fc-be03-25370b2c0820 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with Priority: HIGHEST for action port [ 1350.108858] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_rules [ 1350.108988] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_rules [ 1350.109098] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with Priority: HIGHEST for action port [ 1350.109191] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.109281] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_members [ 1350.109785] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.109972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.109972] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.110525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.110612] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.111511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f87a32d8-f65d-4509-b087-c9a87aa3942d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.111511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.114602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.114827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.114914] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.115672] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.116077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.116077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.116077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.116077] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9923e0cd-a8b7-4138-a10f-11dc1e93c6bf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.116915] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.116915] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.117255] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87a32d8-f65d-4509-b087-c9a87aa3942d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.117347] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.368986] env[69219]: INFO networking_nsxv3.common.synchronization [req-724ed62d-e256-4eb9-88bc-ffc20fef7c64 req-9f228b0d-5bfa-4a2b-bd38-a8a7da15b310 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_members [ 1350.369226] env[69219]: INFO networking_nsxv3.common.synchronization [req-724ed62d-e256-4eb9-88bc-ffc20fef7c64 req-9f228b0d-5bfa-4a2b-bd38-a8a7da15b310 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.369701] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f87a32d8-f65d-4509-b087-c9a87aa3942d with Priority: HIGHEST for action security_group_members [ 1350.369837] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.370174] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87a32d8-f65d-4509-b087-c9a87aa3942d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.370345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.370474] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.370705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.411821] env[69219]: INFO networking_nsxv3.common.synchronization [req-724ed62d-e256-4eb9-88bc-ffc20fef7c64 req-9f228b0d-5bfa-4a2b-bd38-a8a7da15b310 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_rules [ 1350.412026] env[69219]: INFO networking_nsxv3.common.synchronization [req-724ed62d-e256-4eb9-88bc-ffc20fef7c64 req-9f228b0d-5bfa-4a2b-bd38-a8a7da15b310 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.412165] env[69219]: INFO networking_nsxv3.common.synchronization [req-724ed62d-e256-4eb9-88bc-ffc20fef7c64 req-9f228b0d-5bfa-4a2b-bd38-a8a7da15b310 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with Priority: HIGHEST for action port [ 1350.412622] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_rules [ 1350.412803] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1350.412919] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with Priority: HIGHEST for action port [ 1350.413235] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.413349] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.413519] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.413599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.413808] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.413968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.572660] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.573714] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.618800] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with status ACTIVE [ 1350.618992] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.619445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.619445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.619555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.619555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.619730] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.619850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.619932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.620089] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.620162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.620421] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.620511] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.620568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.621343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.621443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.621537] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf is going to be updated. [ 1350.622736] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.622828] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.623031] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-f87a32d8-f65d-4509-b087-c9a87aa3942d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.623120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.641963] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.642061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.642119] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.642753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.642753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.642753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.642753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.643189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.643189] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9923e0cd-a8b7-4138-a10f-11dc1e93c6bf',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.075203] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.076293] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.148522] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf with status ACTIVE [ 1351.148522] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.148522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.148522] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.148798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.148798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.149463] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.149463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.149463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.149463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.149463] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.149702] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.149702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.149702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.149829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.150038] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.150038] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9923e0cd-a8b7-4138-a10f-11dc1e93c6bf is going to be updated. [ 1351.168695] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.168832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.168884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.169096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.169232] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.169381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9923e0cd-a8b7-4138-a10f-11dc1e93c6bf" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.577934] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.578227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.578381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.578673] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.578835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.579011] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87a32d8-f65d-4509-b087-c9a87aa3942d is going to be created. [ 1351.580338] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.581226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.581337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.581547] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.581637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.581736] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be updated. [ 1351.610028] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.610028] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.610258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.610380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.610560] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.612984] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.613161] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.613252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.613470] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.613595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.620378] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f87a32d8-f65d-4509-b087-c9a87aa3942d in Status: UNINITIALIZED for 2s [ 1351.621088] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: IN_PROGRESS for 2s [ 1352.104385] env[69219]: INFO networking_nsxv3.common.synchronization [req-76356ef1-c153-49fd-87c3-e55482329645 req-a22e5a46-f377-4981-8771-4a0891581435 tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_members [ 1352.104995] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_members [ 1352.105232] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.105453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.105453] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.105672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.105906] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.105987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.105987] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.106642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.106642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.106642] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.375834] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.376058] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.376190] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.376535] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.376804] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.376974] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.377260] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.377588] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.377760] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.377980] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1352.378115] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1352.378231] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1352.378347] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1352.378464] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1352.378582] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1352.378722] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1352.396693] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1352.396853] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1352.396994] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1352.397184] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.397472] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-c0ec354b-ea39-41d7-9997-e4372308c7ca taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.397643] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.397770] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.398112] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.398259] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ec354b-ea39-41d7-9997-e4372308c7ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.613234] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.613406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.613526] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.613718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.613826] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.614053] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.614153] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.614236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.614399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.614478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.614582] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc already deleted. [ 1352.614641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.903079] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.903079] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port c0ec354b-ea39-41d7-9997-e4372308c7ca not found, creating... [ 1352.903079] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.903079] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.903694] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.903913] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.904073] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.904396] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.904585] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.904789] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: c0ec354b-ea39-41d7-9997-e4372308c7ca is going to be created. [ 1352.924530] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.924530] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.924530] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.924786] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.924966] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.925230] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.632636] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f87a32d8-f65d-4509-b087-c9a87aa3942d in Status: SUCCESS [ 1353.632899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.633112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.633291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.633451] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.633570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.633632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.633869] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.633927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.634048] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.635925] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1353.636120] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.636233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.636473] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.636567] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.636653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.636712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.636854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.636932] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.637029] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.787898] env[69219]: INFO networking_nsxv3.common.synchronization [req-76356ef1-c153-49fd-87c3-e55482329645 req-388673e9-2bf9-4c1f-9cb9-9f0a66e3e4bb service nova] Enqueued Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_rules [ 1353.788086] env[69219]: INFO networking_nsxv3.common.synchronization [req-76356ef1-c153-49fd-87c3-e55482329645 req-388673e9-2bf9-4c1f-9cb9-9f0a66e3e4bb service nova] Enqueued Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_members [ 1353.788234] env[69219]: INFO networking_nsxv3.common.synchronization [req-76356ef1-c153-49fd-87c3-e55482329645 req-388673e9-2bf9-4c1f-9cb9-9f0a66e3e4bb service nova] Enqueued Resource ID: c0ec354b-ea39-41d7-9997-e4372308c7ca with Priority: HIGHEST for action port [ 1353.788710] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_rules [ 1353.788833] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_members [ 1353.788964] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ec354b-ea39-41d7-9997-e4372308c7ca with Priority: HIGHEST for action port [ 1353.789322] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.789449] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.789512] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.789715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.789794] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.791518] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.791635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.791698] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.791880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.792052] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.792166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.792227] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.792398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.792491] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.792581] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.793336] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0ec354b-ea39-41d7-9997-e4372308c7ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.793450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.793507] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.793658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.793736] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0ec354b-ea39-41d7-9997-e4372308c7ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.139099] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.139210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.139287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.139519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.139618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.139838] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.139964] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.140040] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.140387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.140387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.140387] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87a32d8-f65d-4509-b087-c9a87aa3942d is going to be deleted. [ 1354.141491] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.171603] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.171821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.171821] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.172063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.172162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.172256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.172406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.172579] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.172787] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.172880] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.172953] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.173110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.173184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.173294] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.292451] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.292660] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.295079] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.296190] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0ec354b-ea39-41d7-9997-e4372308c7ca with status ACTIVE [ 1354.296379] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.296503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.296570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.296783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.296925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.297151] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.297254] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.297317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.297561] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.297694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.297886] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.297984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.298078] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.298299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.298394] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.298499] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0ec354b-ea39-41d7-9997-e4372308c7ca is going to be updated. [ 1354.322106] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.322300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.322374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.322624] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.322803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.322967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0ec354b-ea39-41d7-9997-e4372308c7ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.643789] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.675096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.675260] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.675332] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.675550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.675643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.675832] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.675930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.675992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.676151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.676226] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.676309] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87a32d8-f65d-4509-b087-c9a87aa3942d already deleted. [ 1354.676385] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.676521] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.676662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.676806] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.676908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.676970] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.677117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.677191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.677281] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.800230] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.145891] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.146100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.146100] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.146305] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.146399] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.146498] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be updated. [ 1355.172355] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.172485] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.172555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.172803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.172997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.179483] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.179595] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.179662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.179829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.179911] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.180103] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.180211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.180272] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.180412] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.180486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.180566] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f87a32d8-f65d-4509-b087-c9a87aa3942d already deleted. [ 1355.180667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.180762] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.182131] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: IN_PROGRESS for 2s [ 1355.302322] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.302505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.302576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.302768] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.302872] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.302972] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc is going to be created. [ 1355.325089] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.325244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.325244] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.325457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.325944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.334865] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc in Status: UNINITIALIZED for 2s [ 1355.361855] env[69219]: INFO networking_nsxv3.common.synchronization [req-48d43ba4-559b-4a2f-b42d-49e9b8fdd7e9 req-60d64d78-d000-40ee-9a30-5772002efdc9 tempest-ServerRescueTestJSONUnderV235-858693592 tempest-ServerRescueTestJSONUnderV235-858693592-project-member] Enqueued Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1355.362376] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 with Priority: HIGHEST for action security_group_members [ 1355.362693] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.362827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.684114] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f87a32d8-f65d-4509-b087-c9a87aa3942d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.186225] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f87a32d8-f65d-4509-b087-c9a87aa3942d: rpc.has_security_group_logging(os_id): False [ 1356.203376] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.203584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.203670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.203920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.204020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.204223] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.204344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.204401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.204527] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.204599] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.204689] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f87a32d8-f65d-4509-b087-c9a87aa3942d is going to be created. [ 1356.219485] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f87a32d8-f65d-4509-b087-c9a87aa3942d], does not exist path=[/infra/domains/default/groups/f87a32d8-f65d-4509-b087-c9a87aa3942d]."\n}' [ 1356.219668] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f87a32d8-f65d-4509-b087-c9a87aa3942d failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f87a32d8-f65d-4509-b087-c9a87aa3942d [ 1356.219779] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1356.250263] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.250375] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.250422] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.250607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.251273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.251511] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.251922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.252036] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.252206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.252291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.252467] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.252565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.252643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.252813] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.252893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.252981] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f87a32d8-f65d-4509-b087-c9a87aa3942d is going to be created. [ 1356.266158] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f87a32d8-f65d-4509-b087-c9a87aa3942d], does not exist path=[/infra/domains/default/groups/f87a32d8-f65d-4509-b087-c9a87aa3942d]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f87a32d8-f65d-4509-b087-c9a87aa3942d [ 1356.266279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f87a32d8-f65d-4509-b087-c9a87aa3942d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.266459] env[69219]: Traceback (most recent call last): [ 1356.266492] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1356.266492] env[69219]: return func(*args, **kwargs) [ 1356.266492] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1356.266492] env[69219]: res.raise_for_status() [ 1356.266492] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1356.266492] env[69219]: raise HTTPError(http_error_msg, response=self) [ 1356.266492] env[69219]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f87a32d8-f65d-4509-b087-c9a87aa3942d [ 1356.266492] env[69219]: During handling of the above exception, another exception occurred: [ 1356.266492] env[69219]: Traceback (most recent call last): [ 1356.266668] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1356.266668] env[69219]: listener.cb(fileno) [ 1356.266668] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1356.266668] env[69219]: result = function(*args, **kwargs) [ 1356.266668] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1356.266668] env[69219]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1356.266668] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1356.266668] env[69219]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1356.266668] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1356.266668] env[69219]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1356.266668] env[69219]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1356.266668] env[69219]: res.raise_for_status() [ 1356.266668] env[69219]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1356.266668] env[69219]: raise HTTPError(http_error_msg, response=self) [ 1356.266668] env[69219]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f87a32d8-f65d-4509-b087-c9a87aa3942d [ 1356.266668] env[69219]: Removing descriptor: 68 [ 1357.191620] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1357.191938] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.191994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.192198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.192378] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.192494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.192559] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.192709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.192834] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.192958] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.345483] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc in Status: SUCCESS [ 1357.345641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.345786] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.346051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.346246] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.346367] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.346434] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.346588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.346670] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.346760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.346852] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.695162] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.695378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.695417] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.695695] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.724083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.724463] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.724689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.724800] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.725102] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.725188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.725286] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be updated. [ 1357.750334] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.750519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.750519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.750799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.750994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.760903] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: IN_PROGRESS for 2s [ 1357.849556] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.351618] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc: rpc.has_security_group_logging(os_id): False [ 1358.369412] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.369588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.369588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.369803] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.369898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.370150] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.370250] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.370315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.370468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.370544] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.370629] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc is going to be created. [ 1358.430774] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.431021] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.431083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.431315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.431503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.444973] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc in Status: IN_PROGRESS for 2s [ 1359.770309] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1359.770644] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 deletion is rescheduled due to dependency. [ 1359.770644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.770806] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.771013] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.771201] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.771343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.771387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.771534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.771629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.771725] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.273539] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.273689] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.273763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.274012] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.274110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.274310] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.274406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.274465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.274617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.274691] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.274772] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be updated. [ 1360.300327] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.300483] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.300719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.300801] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.301536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.309547] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: IN_PROGRESS for 2s [ 1360.363133] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.363270] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1360.457198] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc in Status: SUCCESS [ 1360.457452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.318907] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1362.318907] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 deletion is rescheduled due to dependency. [ 1362.318907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.319302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.319302] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.319435] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.319549] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.319615] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.319763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.319895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.320014] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.320115] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.320961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.321234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.321332] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.321441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.321506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.321657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.321796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.321842] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.823481] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.824624] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.824762] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.824835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.825065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.825168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.825364] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.825465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.825528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.825680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.825755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.825841] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be updated. [ 1362.849620] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.849760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.849760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.849951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.850103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.857605] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: IN_PROGRESS for 2s [ 1363.327709] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2dd4b0d4-c0ca-44d2-828d-4a60b306b263: rpc.has_security_group_logging(os_id): False [ 1363.345066] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.345255] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.345329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.345566] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.345666] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.345868] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.345983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.346067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.346222] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.346298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.346393] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be updated. [ 1363.395272] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.395462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.395462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.395659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.395791] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.406823] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: IN_PROGRESS for 2s [ 1364.866521] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1364.866863] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 deletion is rescheduled due to dependency. [ 1364.866863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.364318] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.364473] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1365.421509] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 in Status: SUCCESS [ 1365.421725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.421887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.422145] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.422332] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2dd4b0d4-c0ca-44d2-828d-4a60b306b263',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.944202] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.944658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.944658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.944658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.964487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.964596] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2dd4b0d4-c0ca-44d2-828d-4a60b306b263 is going to be deleted. [ 1366.001043] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.001245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.001245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.001443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.001536] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.001668] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2dd4b0d4-c0ca-44d2-828d-4a60b306b263" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.230481] env[69219]: INFO networking_nsxv3.common.synchronization [req-ad477293-babd-4086-a809-523fb6b3cba9 req-52d87121-328b-46cd-8ff1-45c399330b9c tempest-AttachVolumeShelveTestJSON-294296858 tempest-AttachVolumeShelveTestJSON-294296858-project-member] Enqueued Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1370.231063] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c with Priority: HIGHEST for action security_group_members [ 1370.231411] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-766edb0e-98b8-4752-b4a4-66eb148cce1c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.231500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.231693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.231897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.232066] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.232732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.232732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.232732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.232732] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.232732] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('766edb0e-98b8-4752-b4a4-66eb148cce1c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.736454] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.736648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.736688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.736910] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.758155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.758349] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.758472] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.758534] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.758713] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.758794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.758880] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c is going to be updated. [ 1370.781072] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.781218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.781264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.781438] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.781570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.789537] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: IN_PROGRESS for 2s [ 1372.800973] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c in Status: SUCCESS [ 1372.801322] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 766edb0e-98b8-4752-b4a4-66eb148cce1c deletion is rescheduled due to dependency. [ 1372.801322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-766edb0e-98b8-4752-b4a4-66eb148cce1c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.232165] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.232414] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.233410] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.234204] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.234355] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.234613] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.010559] env[69219]: INFO networking_nsxv3.common.synchronization [req-74468e83-1405-45e7-bf0a-897d8aa376b3 req-5c2da2af-7c7a-4ae7-b8bb-0b924d2f9424 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_members [ 1387.011142] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGHEST for action security_group_members [ 1387.011448] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.011588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.011658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.011844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.011999] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.012335] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.012408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.012562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.013306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.013306] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.515640] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.515716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.515716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.515960] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.537053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.537212] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.537300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.537351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.537531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.537619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.537710] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 is going to be updated. [ 1387.562348] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.562506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.562564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.562715] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.562906] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.570186] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab663a3-0671-4475-a619-1f23fb7b27a0 in Status: IN_PROGRESS for 2s [ 1389.580958] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab663a3-0671-4475-a619-1f23fb7b27a0 in Status: SUCCESS [ 1389.581346] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 deletion is rescheduled due to dependency. [ 1389.581346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.011784] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.012113] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.012613] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.012892] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.209134] env[69219]: INFO networking_nsxv3.common.synchronization [req-8d71f8ef-9492-45eb-9af3-2f412f331a4f req-4d21145e-2176-4a2a-a801-4a5b210bca9b tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_members [ 1398.209659] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGHEST for action security_group_members [ 1398.210315] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.210315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.210315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.210489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.210888] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.210888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.210888] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.211108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.211108] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.211191] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.714253] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.714436] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.714528] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.714824] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.737519] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.737761] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.737882] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.737951] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.738164] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.738252] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.738344] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 is going to be updated. [ 1398.761245] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.761406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.761446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.761609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.761742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.768721] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: IN_PROGRESS for 2s [ 1400.778433] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 in Status: SUCCESS [ 1400.778694] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 deletion is rescheduled due to dependency. [ 1400.778724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.835727] env[69219]: INFO networking_nsxv3.common.synchronization [None req-786c4531-35ee-4f39-a70c-c7723be3d332 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_rules [ 1402.836288] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_rules [ 1402.836608] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a326c63d-7d23-4c39-99f5-ffca76edeca7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.836729] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.836799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.837077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.837166] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.906346] env[69219]: INFO networking_nsxv3.common.synchronization [None req-67b69745-5ac7-4902-9a45-43380b86eb92 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_rules [ 1402.906981] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_rules [ 1402.907220] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a326c63d-7d23-4c39-99f5-ffca76edeca7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.907345] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.356182] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.356334] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.356377] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.356573] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.356667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.356763] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 already deleted. [ 1403.356847] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.356990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.357167] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.357871] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.876814] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.877198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.877198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.877198] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.877308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.877377] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 already deleted. [ 1403.877461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.907431] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.907707] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.081339] env[69219]: INFO networking_nsxv3.common.synchronization [req-5d86341e-c483-4c6d-bbbe-2e60d9f87bc8 req-883bc2e3-7c6a-49d8-9fbb-5ed604262722 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_members [ 1409.081789] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_members [ 1409.082231] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a326c63d-7d23-4c39-99f5-ffca76edeca7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.082338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.082411] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.082686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.082873] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.083216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.083216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.083322] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.083571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.083571] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.423024] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.423024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.423024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.423024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.423024] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.423024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.423024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.423024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.423024] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.423657] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.423912] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1409.424184] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1409.425042] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1409.425042] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1409.425042] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1409.425042] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1409.446091] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1409.446244] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1409.446383] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1409.446552] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.446817] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.446979] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.447122] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.447422] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.447568] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('228ab6ea-1372-4bb7-bb5a-7ee2453f73b8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1409.585404] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.585598] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.585676] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.585977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.585977] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.586164] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.586253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.586317] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.586468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.586538] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.586620] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 already deleted. [ 1409.586753] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.949759] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.949962] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.950056] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.950393] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.950580] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.950743] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 not found, creating... [ 1409.951018] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.951350] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.951497] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.951741] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.951891] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.952231] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.952415] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.952539] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.952761] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.952902] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.953144] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 is going to be created. [ 1409.972100] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1409.972353] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1409.972422] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1409.972656] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1409.972878] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1409.973165] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.689452] env[69219]: INFO networking_nsxv3.common.synchronization [req-5d86341e-c483-4c6d-bbbe-2e60d9f87bc8 req-497f3568-898f-4083-8f42-55de0faeee8c service nova] Enqueued Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_rules [ 1410.689704] env[69219]: INFO networking_nsxv3.common.synchronization [req-5d86341e-c483-4c6d-bbbe-2e60d9f87bc8 req-497f3568-898f-4083-8f42-55de0faeee8c service nova] Enqueued Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_members [ 1410.689806] env[69219]: INFO networking_nsxv3.common.synchronization [req-5d86341e-c483-4c6d-bbbe-2e60d9f87bc8 req-497f3568-898f-4083-8f42-55de0faeee8c service nova] Enqueued Resource ID: 228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 with Priority: HIGHEST for action port [ 1410.690021] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_rules [ 1410.690150] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_members [ 1410.690249] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 with Priority: HIGHEST for action port [ 1410.691317] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a326c63d-7d23-4c39-99f5-ffca76edeca7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.691452] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.691523] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.691728] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.691808] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.692665] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a326c63d-7d23-4c39-99f5-ffca76edeca7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.692779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.692849] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.693024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.693239] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.693337] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.693401] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.693548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.693635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.693720] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1410.695154] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1410.695263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1410.695329] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.695482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.695555] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('228ab6ea-1372-4bb7-bb5a-7ee2453f73b8',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.196153] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.198231] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a326c63d-7d23-4c39-99f5-ffca76edeca7 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.198376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.198607] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 with status ACTIVE [ 1411.198815] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.198934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.199031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.199258] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.199387] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.199581] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.199693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.199756] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.199949] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.200057] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.200277] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.200400] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.200464] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.200640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.200724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.200814] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 228ab6ea-1372-4bb7-bb5a-7ee2453f73b8 is going to be updated. [ 1411.222097] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.222233] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.222273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.222480] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.222632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.222796] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-228ab6ea-1372-4bb7-bb5a-7ee2453f73b8" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.700395] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.202506] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.202662] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.202709] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.202917] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.203020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.203175] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 is going to be created. [ 1412.227065] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.227218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.227747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.227747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.227747] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.235964] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 in Status: UNINITIALIZED for 2s [ 1414.245945] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 in Status: SUCCESS [ 1414.246280] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.246320] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.246532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.246721] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.246836] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.246903] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.247073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.247154] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.247243] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.247331] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.749507] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.252451] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a326c63d-7d23-4c39-99f5-ffca76edeca7: rpc.has_security_group_logging(os_id): False [ 1415.270397] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.270554] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.270606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.270817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.270908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.271182] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.271292] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.271356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.271568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.271690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.271818] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 is going to be created. [ 1415.329816] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.330051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.330051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.330240] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.330418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.364226] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 in Status: IN_PROGRESS for 2s [ 1415.690663] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1415.690823] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1416.073638] env[69219]: INFO networking_nsxv3.common.synchronization [req-7301b949-ae42-4548-b872-f844720d757f req-9b63765d-fa52-4706-83fc-91d187051a2e tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1416.074542] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1416.074756] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.074918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.075095] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.075514] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.075514] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.075652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.075652] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.075899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.075899] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.075972] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.578651] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.578952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.578952] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.579127] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.598865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.599152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.599277] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.599344] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.599551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.599631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.599727] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1416.622458] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.622593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.622635] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.624039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.624039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.629777] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1417.375612] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 in Status: SUCCESS [ 1417.375832] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.640252] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1418.640752] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 deletion is rescheduled due to dependency. [ 1418.640752] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.075810] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.076195] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.010373] env[69219]: INFO networking_nsxv3.common.synchronization [req-23da90c0-69bd-4bc7-a993-b8244c864fed req-21914294-ee0e-453c-8409-0700417611ea tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1423.010916] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1423.011259] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.011392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.011457] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.011648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.011822] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.011918] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.011994] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.012146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.012234] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.012325] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.263009] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.263138] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.263286] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.264026] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.264026] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.264233] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.264410] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.264710] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.264922] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.265222] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1423.265393] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1423.265554] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1423.265712] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1423.265871] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1423.266040] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1423.266231] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1423.285172] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1423.285408] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1423.285647] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1423.285883] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-962" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.286294] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.286523] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.286705] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.287116] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.287311] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b772a5-49cc-4a6f-afbd-ea214acd9a8c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.515016] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.515235] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.515299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.515487] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.515584] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.515784] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.515883] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.515941] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.516110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.516189] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.516277] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1423.540096] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.540279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.540279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.540439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.540571] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.548568] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1423.789739] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.789897] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.790054] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.790386] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.790546] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.790712] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 67b772a5-49cc-4a6f-afbd-ea214acd9a8c not found, creating... [ 1423.790991] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.791215] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.791632] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.791632] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.791787] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.792673] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.792673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.792673] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.793119] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.793593] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.793593] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 67b772a5-49cc-4a6f-afbd-ea214acd9a8c is going to be created. [ 1423.812932] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.813156] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.813291] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.813565] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.813795] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.814038] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.475822] env[69219]: INFO networking_nsxv3.common.synchronization [req-23da90c0-69bd-4bc7-a993-b8244c864fed req-9008475a-c482-4f64-94f0-a3a2dc701053 service nova] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 1424.476080] env[69219]: INFO networking_nsxv3.common.synchronization [req-23da90c0-69bd-4bc7-a993-b8244c864fed req-9008475a-c482-4f64-94f0-a3a2dc701053 service nova] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1424.476155] env[69219]: INFO networking_nsxv3.common.synchronization [req-23da90c0-69bd-4bc7-a993-b8244c864fed req-9008475a-c482-4f64-94f0-a3a2dc701053 service nova] Enqueued Resource ID: 67b772a5-49cc-4a6f-afbd-ea214acd9a8c with Priority: HIGHEST for action port [ 1424.476385] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_rules [ 1424.476515] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1424.476611] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b772a5-49cc-4a6f-afbd-ea214acd9a8c with Priority: HIGHEST for action port [ 1424.477149] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.477653] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.477742] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.477935] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.478013] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.478796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.478892] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.479092] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.479192] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.479259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.479426] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.479497] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b772a5-49cc-4a6f-afbd-ea214acd9a8c',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.981119] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.981288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.981489] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67b772a5-49cc-4a6f-afbd-ea214acd9a8c with status ACTIVE [ 1424.981660] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.981766] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.981829] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.982059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.982150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.982316] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.982409] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.982469] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.982618] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.982693] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.982867] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.982954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.983024] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.983162] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.983253] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.983352] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67b772a5-49cc-4a6f-afbd-ea214acd9a8c is going to be updated. [ 1425.002425] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.002541] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.002607] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.002779] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.002904] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.003064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67b772a5-49cc-4a6f-afbd-ea214acd9a8c" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.571047] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1425.571348] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 deletion is rescheduled due to dependency. [ 1425.571383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.571546] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.571754] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.571937] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.572065] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.572129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.572279] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.572362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.572456] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.074608] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.576703] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1427.079461] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.079641] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.079716] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.079943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.080052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.080158] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1427.105724] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.105897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.105954] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.106133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.106281] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.114936] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1429.125544] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1429.125846] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.125925] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.126148] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.126443] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.126531] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.126564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.126735] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.126815] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.126901] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.126990] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.477898] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.478071] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1429.629749] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.132235] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fd497c4-079b-43cf-9489-d33299e4d9c7: rpc.has_security_group_logging(os_id): False [ 1430.149477] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.149649] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.149724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.149890] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.149983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.150254] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.150360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.150419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.150581] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.150658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.150742] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1430.207394] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.207548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.207548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.207736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.207870] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.220178] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1432.234107] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1432.234548] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.479248] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.479630] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.480614] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.480989] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.481738] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.482189] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.483210] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.483552] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.484193] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.484443] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.485414] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.485705] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.486481] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.486823] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.175065] env[69219]: INFO networking_nsxv3.common.synchronization [req-46581a83-cc1a-423d-85a5-13ccf39df1b9 req-7951ee48-0647-4b8d-bcd1-40eaaab9b84d tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_members [ 1466.176122] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 with Priority: HIGHEST for action security_group_members [ 1466.176122] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-a326c63d-7d23-4c39-99f5-ffca76edeca7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.176122] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.176299] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.176384] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.176592] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.176701] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.176758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.176914] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.177011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.177125] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a326c63d-7d23-4c39-99f5-ffca76edeca7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.680112] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.680112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.680112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.680112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.680112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.680570] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.680570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.680570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.680570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.680570] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.680825] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 is going to be updated. [ 1466.708142] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.708364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.708364] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.708468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.708602] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.716441] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 in Status: IN_PROGRESS for 2s [ 1468.726993] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 in Status: SUCCESS [ 1468.727361] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a326c63d-7d23-4c39-99f5-ffca76edeca7 deletion is rescheduled due to dependency. [ 1468.727361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a326c63d-7d23-4c39-99f5-ffca76edeca7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.791839] env[69219]: INFO networking_nsxv3.common.synchronization [None req-880c5a02-ef77-467e-aa6d-dfcf6211f225 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_rules [ 1470.793197] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_rules [ 1470.793197] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.793497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.793497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.793772] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.793888] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1470.858853] env[69219]: INFO networking_nsxv3.common.synchronization [None req-344ed001-3c6f-4575-8f7c-edb4807a4a62 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_rules [ 1470.858853] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_rules [ 1470.858924] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.859482] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.313619] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.313805] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.313934] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.314073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.314166] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.314260] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6052796-423c-4d21-890b-6acf251e0eeb already deleted. [ 1471.314346] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.314490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.314688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.314778] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.834494] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.834780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.834780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.834919] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.835020] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.835118] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6052796-423c-4d21-890b-6acf251e0eeb already deleted. [ 1471.835207] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.859432] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.859785] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.035977] env[69219]: INFO networking_nsxv3.common.synchronization [req-3b63836e-f04c-4d12-93cd-ace426760d88 req-359cdb0c-5682-49cc-9292-dd97e35138e9 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_members [ 1476.036565] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_members [ 1476.036929] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.037129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.037214] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.037515] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.037703] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.037841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.037905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.038146] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.038180] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.038280] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.290596] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.290809] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.290939] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.291321] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.291540] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.291707] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.291827] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.292074] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.292236] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.292449] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1476.292567] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1476.292681] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1476.292790] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1476.292905] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1476.293026] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1476.293178] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1476.320740] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1476.320986] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1476.321153] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1476.321367] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-246" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.321716] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-aea39cb6-c3b9-4e7b-af44-40433f913640 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.321909] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.322028] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.322368] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.322504] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aea39cb6-c3b9-4e7b-af44-40433f913640',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.541283] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.541564] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.541613] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.541948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.542084] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.542292] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.542381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.542445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.542606] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.542718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.542824] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6052796-423c-4d21-890b-6acf251e0eeb already deleted. [ 1476.542936] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.825104] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.825432] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.825531] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.825814] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.825936] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.826104] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port aea39cb6-c3b9-4e7b-af44-40433f913640 not found, creating... [ 1476.826413] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.826515] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.826668] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.826863] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.827012] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.827313] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.827473] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.827591] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.827803] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.827940] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.828095] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: aea39cb6-c3b9-4e7b-af44-40433f913640 is going to be created. [ 1476.849779] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.849931] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.850287] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.850347] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.850522] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.850758] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.538286] env[69219]: INFO networking_nsxv3.common.synchronization [req-3b63836e-f04c-4d12-93cd-ace426760d88 req-21d71259-9660-4d95-bc13-0f2b1fa42a8f service nova] Enqueued Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_rules [ 1477.538536] env[69219]: INFO networking_nsxv3.common.synchronization [req-3b63836e-f04c-4d12-93cd-ace426760d88 req-21d71259-9660-4d95-bc13-0f2b1fa42a8f service nova] Enqueued Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_members [ 1477.538536] env[69219]: INFO networking_nsxv3.common.synchronization [req-3b63836e-f04c-4d12-93cd-ace426760d88 req-21d71259-9660-4d95-bc13-0f2b1fa42a8f service nova] Enqueued Resource ID: aea39cb6-c3b9-4e7b-af44-40433f913640 with Priority: HIGHEST for action port [ 1477.538811] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_rules [ 1477.538920] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_members [ 1477.539086] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea39cb6-c3b9-4e7b-af44-40433f913640 with Priority: HIGHEST for action port [ 1477.539987] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.540133] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.540202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.540415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.540501] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.541380] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.541562] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.541617] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.541787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.541940] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.542045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.542109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.542256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.542351] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.542435] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.543241] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-aea39cb6-c3b9-4e7b-af44-40433f913640 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.543343] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.543435] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.543574] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.543652] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aea39cb6-c3b9-4e7b-af44-40433f913640',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.046089] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.046263] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.047973] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.048922] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aea39cb6-c3b9-4e7b-af44-40433f913640 with status ACTIVE [ 1478.049135] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.049259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.049321] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.049532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.049623] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.049805] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.049905] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.049961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.050278] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.050378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.050589] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.050697] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.050763] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.050976] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.051105] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.051212] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aea39cb6-c3b9-4e7b-af44-40433f913640 is going to be updated. [ 1478.070187] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.070410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.070410] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.070601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.070740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.070948] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aea39cb6-c3b9-4e7b-af44-40433f913640" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.553895] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1479.056334] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.056501] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.056600] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.057661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.057661] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.057661] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6052796-423c-4d21-890b-6acf251e0eeb is going to be created. [ 1479.078968] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1479.079142] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1479.079211] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1479.079415] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1479.079583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.087530] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6052796-423c-4d21-890b-6acf251e0eeb in Status: UNINITIALIZED for 2s [ 1481.098090] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6052796-423c-4d21-890b-6acf251e0eeb in Status: SUCCESS [ 1481.098462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.098462] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.098658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.098927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1481.099092] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1481.099199] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1481.099298] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1481.099381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.099467] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.099556] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1481.602265] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.105899] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6052796-423c-4d21-890b-6acf251e0eeb: rpc.has_security_group_logging(os_id): False [ 1482.125377] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.125594] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.125655] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.125865] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.125974] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.126270] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.126391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.126461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.126642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.126740] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.126844] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6052796-423c-4d21-890b-6acf251e0eeb is going to be created. [ 1482.194461] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.194694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.194694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.194895] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.195097] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.204496] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6052796-423c-4d21-890b-6acf251e0eeb in Status: IN_PROGRESS for 2s [ 1482.540605] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.540682] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1484.216133] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6052796-423c-4d21-890b-6acf251e0eeb in Status: SUCCESS [ 1484.216406] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.238053] env[69219]: INFO networking_nsxv3.common.synchronization [req-e7c407dd-f9f9-4791-a1de-7e31a2321d43 req-59daf0d1-8631-4777-9f89-deb37cd5a5f1 tempest-ServerActionsTestJSON-2059958573 tempest-ServerActionsTestJSON-2059958573-project-member] Enqueued Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1485.238573] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 with Priority: HIGHEST for action security_group_members [ 1485.238883] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fd497c4-079b-43cf-9489-d33299e4d9c7 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.239011] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.239087] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.239312] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.239472] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.239589] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.239723] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.239817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.239893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.239983] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fd497c4-079b-43cf-9489-d33299e4d9c7',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1485.743571] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.743758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.743838] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.744091] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.744205] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.745029] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.745029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.745029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.745029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.745029] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.745029] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 is going to be updated. [ 1485.773603] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.773792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.773891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.774103] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.774249] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.782345] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: IN_PROGRESS for 2s [ 1487.793080] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 in Status: SUCCESS [ 1487.793080] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fd497c4-079b-43cf-9489-d33299e4d9c7 deletion is rescheduled due to dependency. [ 1487.793080] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fd497c4-079b-43cf-9489-d33299e4d9c7" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.239764] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.240106] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.241504] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.241886] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.557056] env[69219]: INFO networking_nsxv3.common.synchronization [req-c5bcb46e-6592-497d-9b0c-86bc3bdb98b9 req-ba9c6bfa-c120-4a57-b8bc-28a6350aa55e tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_members [ 1499.557584] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGHEST for action security_group_members [ 1499.557930] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.558046] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.558114] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.558326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.558484] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1499.558597] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1499.558656] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1499.558827] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1499.558912] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.559019] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.061027] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.061027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.061027] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.061361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.061361] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.061481] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.061582] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.061634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.061783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.061858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.061943] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc is going to be updated. [ 1500.106275] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.106461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.106461] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.106642] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.106780] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.114405] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc in Status: IN_PROGRESS for 2s [ 1502.125253] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc in Status: SUCCESS [ 1502.125644] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc deletion is rescheduled due to dependency. [ 1502.125644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.153791] env[69219]: INFO networking_nsxv3.common.synchronization [None req-5ea5994f-7e97-40f3-98b6-3912e1826290 tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_rules [ 1504.154422] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_rules [ 1504.154422] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.154551] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.154640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.154858] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.154939] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1504.214602] env[69219]: INFO networking_nsxv3.common.synchronization [None req-a850c962-7e07-4cff-868f-9a7a831a6e17 tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_rules [ 1504.214778] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_rules [ 1504.215263] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.215383] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.679655] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1504.679794] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1504.679884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.680177] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.680323] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.680458] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d already deleted. [ 1504.680565] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1504.680733] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1504.680927] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1504.681043] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1505.200766] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1505.201096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1505.201096] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1505.201218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1505.201273] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.201367] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d already deleted. [ 1505.201451] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.216282] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.216570] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.391408] env[69219]: INFO networking_nsxv3.common.synchronization [req-4875eb16-74a6-4f89-a462-ba7bc74b380b req-b50b6e5e-fa2b-44a6-b136-bf6c89e344ef tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_members [ 1509.391976] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_members [ 1509.392321] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.392440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.392505] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.392778] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.392926] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.393044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.393109] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.393297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.393391] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.393438] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.626958] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.627175] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.627304] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.627577] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.627838] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.628013] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.628145] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.628369] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.628526] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.628745] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1509.628866] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] NeedRegenerationException {{(pid=69219) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1509.628980] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] no value, waiting for create lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1509.629160] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] value creation lock acquired {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1509.629283] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] No value present for key: 'zone-id' {{(pid=69219) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1509.629397] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Calling creation function for not-yet-present value {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1509.629535] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1509.651556] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1509.651722] env[69219]: DEBUG dogpile.cache.region [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69219) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1509.651866] env[69219]: DEBUG dogpile.lock [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Released creation lock {{(pid=69219) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1509.652054] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "network-295" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.652364] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock port-9b06c675-5f4e-44bf-a76f-bb344e959a42 taken with stack trace [, , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.652552] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.652645] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.652964] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.653122] env[69219]: DEBUG networking_nsxv3.api.rpc [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b06c675-5f4e-44bf-a76f-bb344e959a42',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.895716] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.895908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.895908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.896112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.896202] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.896399] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.896496] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.896556] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.896708] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.896783] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.896866] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d already deleted. [ 1509.896943] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.155281] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.155535] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.155670] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.155985] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.156178] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.156573] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Segment Port 9b06c675-5f4e-44bf-a76f-bb344e959a42 not found, creating... [ 1510.156856] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.157047] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.157173] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.157403] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.157548] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.157838] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.157999] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.158185] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.158400] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.158543] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.158687] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Resource: SegmentPort with ID: 9b06c675-5f4e-44bf-a76f-bb344e959a42 is going to be created. [ 1510.178768] env[69219]: DEBUG networking_nsxv3.common.locking [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.178954] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.179090] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.179382] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.179626] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.179843] env[69219]: DEBUG oslo_concurrency.lockutils [None req-bf1c9b4f-3354-4e30-a8ce-5d836b9b53bb None None] Releasing lock "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.834108] env[69219]: INFO networking_nsxv3.common.synchronization [req-4875eb16-74a6-4f89-a462-ba7bc74b380b req-8ad838bb-7b6f-4694-8160-0e3a522de9d3 service nova] Enqueued Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_rules [ 1510.834363] env[69219]: INFO networking_nsxv3.common.synchronization [req-4875eb16-74a6-4f89-a462-ba7bc74b380b req-8ad838bb-7b6f-4694-8160-0e3a522de9d3 service nova] Enqueued Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_members [ 1510.834456] env[69219]: INFO networking_nsxv3.common.synchronization [req-4875eb16-74a6-4f89-a462-ba7bc74b380b req-8ad838bb-7b6f-4694-8160-0e3a522de9d3 service nova] Enqueued Resource ID: 9b06c675-5f4e-44bf-a76f-bb344e959a42 with Priority: HIGHEST for action port [ 1510.834674] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_rules [ 1510.834810] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_members [ 1510.834909] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b06c675-5f4e-44bf-a76f-bb344e959a42 with Priority: HIGHEST for action port [ 1510.835472] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.835596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.835665] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.835850] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.835932] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.836919] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.837044] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.837112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.837350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.837521] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.837643] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.837724] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.837889] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.838007] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.838151] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.839630] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b06c675-5f4e-44bf-a76f-bb344e959a42 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.839630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.839630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.839630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.839630] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b06c675-5f4e-44bf-a76f-bb344e959a42',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.341346] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.341478] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.341698] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1511.342708] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b06c675-5f4e-44bf-a76f-bb344e959a42 with status ACTIVE [ 1511.342983] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.343186] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.343311] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.343545] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.343686] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.345163] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.345315] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.345390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.345588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.345680] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.345927] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.346074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.346140] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.346306] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.346388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.346478] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b06c675-5f4e-44bf-a76f-bb344e959a42 is going to be updated. [ 1511.368856] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.369047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.369047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.369251] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.369380] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.369532] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b06c675-5f4e-44bf-a76f-bb344e959a42" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.848792] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.351663] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.351863] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.351908] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.352151] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.352245] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.352350] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d is going to be created. [ 1512.374893] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.375079] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.375155] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.375354] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.375506] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.384113] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d in Status: UNINITIALIZED for 2s [ 1514.395684] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d in Status: SUCCESS [ 1514.396116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.396116] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.396350] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.396576] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.396719] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.396795] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.396990] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.397090] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.397206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.397303] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.899628] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1515.402224] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d: rpc.has_security_group_logging(os_id): False [ 1515.419018] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.419187] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.419247] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.419492] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.419609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.419857] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.419963] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.420042] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.420210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.420283] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.420370] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d is going to be created. [ 1515.477890] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.478045] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.478085] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.478264] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.478448] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.490169] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d in Status: IN_PROGRESS for 2s [ 1515.835518] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.835728] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1517.502129] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d in Status: SUCCESS [ 1517.502494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1520.837098] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.837098] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.838515] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.838906] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1530.839577] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.839980] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.841345] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.841684] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1538.752077] env[69219]: INFO networking_nsxv3.common.synchronization [req-1c8aa3bb-3c47-4f54-8c1f-a1a951b9e532 req-160345c8-d1b8-4c06-970a-1c5d007dcaf5 tempest-AttachVolumeNegativeTest-2100596387 tempest-AttachVolumeNegativeTest-2100596387-project-member] Enqueued Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_members [ 1538.752077] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGHEST for action security_group_members [ 1538.752077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.752077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.752077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.752077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.752077] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.752077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.752077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.752077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.752077] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.752077] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1539.255154] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.255360] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.255432] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.255604] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.255699] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.255896] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.255989] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.256064] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.256210] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.256308] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.256393] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6052796-423c-4d21-890b-6acf251e0eeb is going to be updated. [ 1539.284131] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.284287] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.284325] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.284497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.284631] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.292531] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6052796-423c-4d21-890b-6acf251e0eeb in Status: IN_PROGRESS for 2s [ 1541.303156] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6052796-423c-4d21-890b-6acf251e0eeb in Status: SUCCESS [ 1541.303539] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6052796-423c-4d21-890b-6acf251e0eeb deletion is rescheduled due to dependency. [ 1541.303539] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.751942] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.752402] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.191252] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1547.191596] env[69219]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1da8d713-f096-4bd2-a54a-091b1c46d6fb None None] NSXv3 Agent Agent loop - iteration:4 started [ 1548.753015] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.753409] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.754271] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.754640] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1558.756218] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.756218] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1563.756858] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1563.757190] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1568.758055] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1568.758055] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1573.759407] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.759717] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1576.146038] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.146468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.146468] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.146576] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.146606] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.650426] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.153064] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1577.655255] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1577.655468] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1578.408928] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.409392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.409392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.409392] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.420491] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1578.422669] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.423418] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1578.460181] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.460374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.460374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.460577] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.473965] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.474703] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1578.474788] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1578.474868] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1578.506240] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.506390] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.506465] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.506664] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.507388] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.507533] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1578.588279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.588497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.588497] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.588690] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.588992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.589270] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1578.671279] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.671445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.671445] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.671628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.671920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.672215] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:27. [ 1578.672302] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc', 'e9db9d77-0b95-4c7b-9735-29c3f3d86409', 'ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d', 'd5e5bd65-43e8-43dd-ba51-515caef2f24d', 'bab663a3-0671-4475-a619-1f23fb7b27a0', 'df327ac5-73cd-478c-b19b-3849894e070d', '04ba1205-02a7-4968-99ca-25d19305f8e9', '49f615d4-07b5-4c31-a7c9-afa72b7059c0', 'c6052796-423c-4d21-890b-6acf251e0eeb', 'bfae446e-9362-456c-b5ff-375627350736', '398e7926-33dc-450f-9584-34ddbd0ed03a', '0687614d-5fbe-486f-942e-47e8dcdc82e2', '7fdacd70-c14b-4dd0-9cba-de8872db32ca', 'ba38a24c-584a-4fc2-8fc4-91929e372e75', 'ee58207b-f6f5-4d2a-b0d7-fb2dc440c630', '39c47700-2196-4adc-afd5-b72e818055ee', '55b28f2a-86c9-4b72-a2dc-7c308af8d9e3', 'd679379b-ec68-4cf7-8ccd-4f2d4d8b12dd', '0d7564b1-7081-4c22-95c9-b5c511c04590', '50a3720b-a5ee-456e-b60f-4ae4d9b5fe98', '1842eb8d-0b7b-4b1b-8259-8b82f06aa47d', '9fd497c4-079b-43cf-9489-d33299e4d9c7', '605a443b-d883-4950-9fad-dd508996ac8f', '1e06ed06-d558-4f57-8586-39a8c2f2a293', 'a326c63d-7d23-4c39-99f5-ffca76edeca7', 'fd4746a8-624d-411a-b8a7-b5c965021a51', '766edb0e-98b8-4752-b4a4-66eb148cce1c'} {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1578.672390] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1578.689811] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.689968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.689968] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.690168] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.690248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.690345] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1578.690414] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1578.690482] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1578.761487] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.761644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.761688] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.761833] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.762959] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.763205] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1578.763284] env[69219]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69219) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1578.763355] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1578.763419] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1578.763493] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/27 resources of Type:Security Group Rules [ 1578.763576] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGH for action security_group_rules [ 1578.763655] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGH for action security_group_rules [ 1578.763722] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGH for action security_group_rules [ 1578.763784] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGH for action security_group_rules [ 1578.763846] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGH for action security_group_rules [ 1578.763908] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGH for action security_group_rules [ 1578.763969] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGH for action security_group_rules [ 1578.764043] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGH for action security_group_rules [ 1578.764101] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGH for action security_group_rules [ 1578.764162] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGH for action security_group_rules [ 1578.764278] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGH for action security_group_rules [ 1578.764345] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGH for action security_group_rules [ 1578.764405] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGH for action security_group_rules [ 1578.764466] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGH for action security_group_rules [ 1578.764527] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGH for action security_group_rules [ 1578.764580] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGH for action security_group_rules [ 1578.764643] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGH for action security_group_rules [ 1578.764702] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGH for action security_group_rules [ 1578.764766] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGH for action security_group_rules [ 1578.764823] env[69219]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGH for action security_group_rules [ 1578.764916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.765138] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.765208] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1578.765313] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc with Priority: HIGH for action security_group_rules [ 1578.765420] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d with Priority: HIGH for action security_group_rules [ 1578.765511] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 with Priority: HIGH for action security_group_rules [ 1578.765599] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 with Priority: HIGH for action security_group_rules [ 1578.765688] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 with Priority: HIGH for action security_group_rules [ 1578.765772] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 with Priority: HIGH for action security_group_rules [ 1578.765856] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd with Priority: HIGH for action security_group_rules [ 1578.765938] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 with Priority: HIGH for action security_group_rules [ 1578.766031] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 with Priority: HIGH for action security_group_rules [ 1578.766117] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39c47700-2196-4adc-afd5-b72e818055ee with Priority: HIGH for action security_group_rules [ 1578.766202] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca with Priority: HIGH for action security_group_rules [ 1578.766287] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 with Priority: HIGH for action security_group_rules [ 1578.766370] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398e7926-33dc-450f-9584-34ddbd0ed03a with Priority: HIGH for action security_group_rules [ 1578.766453] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfae446e-9362-456c-b5ff-375627350736 with Priority: HIGH for action security_group_rules [ 1578.766549] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6052796-423c-4d21-890b-6acf251e0eeb with Priority: HIGH for action security_group_rules [ 1578.766644] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df327ac5-73cd-478c-b19b-3849894e070d with Priority: HIGH for action security_group_rules [ 1578.766729] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 with Priority: HIGH for action security_group_rules [ 1578.766811] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab663a3-0671-4475-a619-1f23fb7b27a0 with Priority: HIGH for action security_group_rules [ 1578.766894] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 with Priority: HIGH for action security_group_rules [ 1578.766976] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d with Priority: HIGH for action security_group_rules [ 1578.767266] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.767372] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.767427] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.767578] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.767652] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.768527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.768637] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.768692] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.768841] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.768939] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.769669] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04ba1205-02a7-4968-99ca-25d19305f8e9 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.769774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.769837] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.769983] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.770065] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04ba1205-02a7-4968-99ca-25d19305f8e9',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.771049] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.771150] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.771236] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.771371] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.771442] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee58207b-f6f5-4d2a-b0d7-fb2dc440c630',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.772103] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.772216] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.772293] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.772441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.772514] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50a3720b-a5ee-456e-b60f-4ae4d9b5fe98',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.773191] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d7564b1-7081-4c22-95c9-b5c511c04590 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.773295] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.773363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.773508] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.773579] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d7564b1-7081-4c22-95c9-b5c511c04590',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.774292] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.774381] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.774413] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.774550] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.774611] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.775277] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.775494] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.775563] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.775730] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.775799] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55b28f2a-86c9-4b72-a2dc-7c308af8d9e3',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.776455] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba38a24c-584a-4fc2-8fc4-91929e372e75 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.776580] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.776658] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.776810] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.776884] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba38a24c-584a-4fc2-8fc4-91929e372e75',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.777529] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39c47700-2196-4adc-afd5-b72e818055ee taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.777636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.777704] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.777898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.777978] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39c47700-2196-4adc-afd5-b72e818055ee',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.778650] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.778736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.778775] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.778923] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.779048] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdacd70-c14b-4dd0-9cba-de8872db32ca',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.779727] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0687614d-5fbe-486f-942e-47e8dcdc82e2 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.779864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.779893] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.780049] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.780120] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0687614d-5fbe-486f-942e-47e8dcdc82e2',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.780756] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-398e7926-33dc-450f-9584-34ddbd0ed03a taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.780861] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.780922] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.781083] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.781149] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('398e7926-33dc-450f-9584-34ddbd0ed03a',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.781796] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfae446e-9362-456c-b5ff-375627350736 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.781907] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.781956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.782117] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.782216] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfae446e-9362-456c-b5ff-375627350736',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.782853] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6052796-423c-4d21-890b-6acf251e0eeb taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.782955] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.783031] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.783182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.783254] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6052796-423c-4d21-890b-6acf251e0eeb',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.783986] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df327ac5-73cd-478c-b19b-3849894e070d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.784104] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.784169] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.784338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.784413] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df327ac5-73cd-478c-b19b-3849894e070d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.785148] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.785300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.785374] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.785525] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.785596] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49f615d4-07b5-4c31-a7c9-afa72b7059c0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.786259] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bab663a3-0671-4475-a619-1f23fb7b27a0 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.786368] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.786433] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.786583] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.786720] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bab663a3-0671-4475-a619-1f23fb7b27a0',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.787486] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409 taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.787639] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.787675] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.787807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.787878] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9db9d77-0b95-4c7b-9735-29c3f3d86409',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.788529] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.788636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.788720] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.788843] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.788912] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5e5bd65-43e8-43dd-ba51-515caef2f24d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1578.811580] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.811718] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.811760] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.811933] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.816896] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.817032] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.829356] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.829468] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc is going to be deleted. [ 1578.830195] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.830376] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.845237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.845380] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d is going to be deleted. [ 1578.882446] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.882596] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.882640] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.882787] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.882871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.882984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcd761f8-a7f4-40a8-9dd2-3c5d071c0acc" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.894298] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1578.894414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1578.894455] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1578.894622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1578.894703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.894817] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff6e65bb-3d14-450f-8a35-3e88cbcd4f7d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.353515] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.353705] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.353749] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.353930] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.355524] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.355644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.356351] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.356418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.357105] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.357200] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.357868] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.357961] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.358901] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.359017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.359678] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.359774] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.360518] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.360601] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.361283] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.361378] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.362039] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.362137] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.362770] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.362855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.363458] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1579.363857] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.363950] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.364537] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1579.364906] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.365016] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.365586] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1579.365932] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.366039] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.366635] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1579.367022] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.367112] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.367700] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1579.368071] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.368157] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.368727] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1579.369110] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.369206] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.369775] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1579.370184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.370314] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49f615d4-07b5-4c31-a7c9-afa72b7059c0 is going to be deleted. [ 1579.371644] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.371738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.371804] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.371979] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.386106] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.386217] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd is going to be deleted. [ 1579.386884] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.387073] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.401630] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.401726] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdacd70-c14b-4dd0-9cba-de8872db32ca is going to be deleted. [ 1579.402419] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.402592] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.419856] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.420127] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfae446e-9362-456c-b5ff-375627350736 is going to be deleted. [ 1579.420663] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.420823] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.432607] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.432712] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.438082] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.438189] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04ba1205-02a7-4968-99ca-25d19305f8e9 is going to be deleted. [ 1579.438866] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.439047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.457107] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.457208] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.461203] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.461297] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.464913] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.465030] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee58207b-f6f5-4d2a-b0d7-fb2dc440c630 is going to be deleted. [ 1579.465725] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.465898] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.467530] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.467627] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.532441] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.532441] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.533086] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.533201] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba38a24c-584a-4fc2-8fc4-91929e372e75 is going to be deleted. [ 1579.533939] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.534130] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.571460] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.571562] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bab663a3-0671-4475-a619-1f23fb7b27a0 is going to be deleted. [ 1579.572303] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.572490] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.592527] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.592634] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.612992] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.613142] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39c47700-2196-4adc-afd5-b72e818055ee is going to be deleted. [ 1579.613855] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.614052] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.634525] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.634632] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.647489] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.647489] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55b28f2a-86c9-4b72-a2dc-7c308af8d9e3 is going to be deleted. [ 1579.648237] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.648443] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.688380] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.688524] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.695887] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.695998] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0687614d-5fbe-486f-942e-47e8dcdc82e2 is going to be deleted. [ 1579.696792] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.696985] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.788053] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.788206] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6052796-423c-4d21-890b-6acf251e0eeb is going to be deleted. [ 1579.789218] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.789440] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.791490] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.791609] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.800152] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.800288] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.866280] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.866446] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.868702] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.868817] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9db9d77-0b95-4c7b-9735-29c3f3d86409 is going to be deleted. [ 1579.869659] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.869871] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.937956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.938099] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5e5bd65-43e8-43dd-ba51-515caef2f24d is going to be deleted. [ 1579.938891] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.939115] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.940419] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.940535] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.989017] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.989155] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d7564b1-7081-4c22-95c9-b5c511c04590 is going to be deleted. [ 1579.989859] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.990074] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.052301] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.052437] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50a3720b-a5ee-456e-b60f-4ae4d9b5fe98 is going to be deleted. [ 1580.053213] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.053414] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.100870] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.101051] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.103790] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.103967] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.113068] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.113178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.126628] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.126719] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 398e7926-33dc-450f-9584-34ddbd0ed03a is going to be deleted. [ 1580.127657] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.127862] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.164636] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.164752] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df327ac5-73cd-478c-b19b-3849894e070d is going to be deleted. [ 1580.165610] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.165807] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.165897] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.166026] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d679379b-ec68-4cf7-8ccd-4f2d4d8b12dd" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.166181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.166338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.166418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.166537] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49f615d4-07b5-4c31-a7c9-afa72b7059c0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.166997] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.167178] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.167259] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.167377] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdacd70-c14b-4dd0-9cba-de8872db32ca" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.167503] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.167648] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.167726] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.167835] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfae446e-9362-456c-b5ff-375627350736" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.167956] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.168110] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.168184] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.168291] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04ba1205-02a7-4968-99ca-25d19305f8e9" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.168418] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.168555] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.168629] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.168736] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee58207b-f6f5-4d2a-b0d7-fb2dc440c630" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.168854] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.168991] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.169075] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.169181] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba38a24c-584a-4fc2-8fc4-91929e372e75" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.169300] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.169439] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.169513] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.169619] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bab663a3-0671-4475-a619-1f23fb7b27a0" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.169738] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.169873] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.169944] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.170071] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39c47700-2196-4adc-afd5-b72e818055ee" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.170188] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.170326] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.170398] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.170500] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55b28f2a-86c9-4b72-a2dc-7c308af8d9e3" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.170616] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.170750] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.170822] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.170920] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0687614d-5fbe-486f-942e-47e8dcdc82e2" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.171047] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.171182] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.171256] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.171363] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6052796-423c-4d21-890b-6acf251e0eeb" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.171486] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.171622] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.171694] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.171799] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5e5bd65-43e8-43dd-ba51-515caef2f24d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.171916] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.172059] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.172132] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.172241] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9db9d77-0b95-4c7b-9735-29c3f3d86409" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.172362] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.172495] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.172568] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.172667] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d7564b1-7081-4c22-95c9-b5c511c04590" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.201441] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.201593] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.201646] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.201798] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.201878] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.201988] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50a3720b-a5ee-456e-b60f-4ae4d9b5fe98" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.227610] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.227758] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.227797] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.227962] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.228063] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.228204] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-398e7926-33dc-450f-9584-34ddbd0ed03a" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.245419] env[69219]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1580.245857] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.245975] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.246054] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.246230] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.246338] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.246450] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df327ac5-73cd-478c-b19b-3849894e070d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.768173] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.768542] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1587.790145] env[69219]: INFO networking_nsxv3.common.synchronization [req-27675584-1ee7-43a0-9260-fa796748fbd8 req-541f9202-6b38-4187-990b-fcb80deac81d tempest-AttachVolumeTestJSON-1067276556 tempest-AttachVolumeTestJSON-1067276556-project-member] Enqueued Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_members [ 1587.790683] env[69219]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d with Priority: HIGHEST for action security_group_members [ 1587.790992] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d taken with stack trace [, , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.791129] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.791191] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.791389] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.791544] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1587.791644] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1587.791703] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1587.791844] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1587.791926] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1587.792020] env[69219]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1842eb8d-0b7b-4b1b-8259-8b82f06aa47d',) {} {{(pid=69219) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1588.294780] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.295067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.295067] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.295248] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.319984] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.320231] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.320340] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.320408] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.320588] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.320672] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.320760] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d is going to be updated. [ 1588.347673] env[69219]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69219) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.347864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.347864] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.348061] env[69219]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.348196] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.355729] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d in Status: IN_PROGRESS for 2s [ 1590.367329] env[69219]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d in Status: SUCCESS [ 1590.367755] env[69219]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1842eb8d-0b7b-4b1b-8259-8b82f06aa47d deletion is rescheduled due to dependency. [ 1590.367755] env[69219]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1842eb8d-0b7b-4b1b-8259-8b82f06aa47d" {{(pid=69219) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1592.791267] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1592.791649] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.792783] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1597.793178] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1602.794872] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.794872] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.795152] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.795547] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.795933] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.796332] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.797682] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.798042] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1622.799336] env[69219]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1622.800350] env[69219]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0